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The  research  discussed  in  this  report  was  performed  by  the 
Soldier-System  Effectiveness  Team  of  the  Fort  Bliss  Field  Unit  of 
the  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social 
sciences  (ARI) .  The  mission  of  this  team  is  to  perform  research 
and  development  in  human  performance  issues  relevant  to  improving 
Army  air  defense  effectiveness.  Field  tests  have  shown  that  the 
engagement  performance  of  Stinger  teams  is  impaired  by  wearing 
M0PP4  chemical  protective  clothing  for  long  periods  of  time 
during  sustained  operations.  Is  this  impairment  caused  (a)  by 
the  wearing  of  the  M0PP4  clothing  itself,  (b)  by  the  reG[uirement 
to  operate  in  this  chemical  protective  clothing  for  long 
durations  in  sustained  operations,  or  (c)  by  some  interaction 
between  the  clothing  and  the  duration  it  is  worn?  The  objective 
of  this  research  was  to  quantify  the  magnitude  of  the  performance 
decrement  caused  specifically  by  wearing  the  M0PP4  clothing 
itself.  The  effect  on  performance  of  extended  operations  in 
M0PP4  was  not  investigated.  A  second  objective  of  this  research 
was  to  determine  if  extensive  prior  experience  with  and  training 
in  M0PP4  clothing  improved  engagement  performance. 

This  research  is  part  of  a  larger  team  project  entitled 
"Forward  Area  Air  Defense  (FAAD)  Performance  During  Engagement 
Operations  in  a  Chemical  Environment,"  which  is  funded  by  the 
Physiological  and  Psychological  Effects  of  the  Nuclear, 
Biological,  and  Chemical  Environment  and  Sustained  Operations  on 
Systems  in  Combat  (P^NBC^)  program  administered  by  the  U.S.  Army 
Chemical  School  at  Fort  McClellan.  The  proponent  agency  for  this 
research  is  the  Directorate  of  Combat  Developments  at  the  U.S. 
Army  Air  Defense  Artillery  School  (USAADASCH)  at  Fort  Bliss.  A 
Memorandum  of  Agreement  covering  this  research  project  was  signed 
on  7  November  1991  by  USAADASCH  and  ARI. 


The  results  of  this  research  vrere  presented  to  Colonel 
Schnakenberg ,  Chairman,  and  members  of  the  P^NBC^  Technical  and 
Scientific  Advisory  Group  as  a  final  test  report  in  December 
1991.  The  final  test  report  was  evaluated  by  the  proponent  in  an 
Abbreviated  Operational  Assessment  (AOA)  memorandum  dated  31 
March  1992.  In  this  AOA,  the  proponent  concurred  with  the 
results  in  the  final  test  report. 
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STINGER  TEAM  PERFORMANCE  DURING  ENGAGEMENT  OPERATIONS  IN  A 
CHEMICAL  ENVIRONMENT:  THE  EFFECT  OF  EXPERIENCE 


EXECUTIVE  SUMMARY 


Requirement: 

To  quantify  the  extent  to  which  Stinger  team  engagement 
performance  is  impaired  by  wearing  MOPP4  chemical  protective 
clothing.  To  deteirmine  if  extensive  prior  experience  with  and 
training  in  M0PP4  will  improve  engagement  performance. 


Procedure : 

A  design  was  chosen  to  measure  the  effects  on  performance  of 
wearing  M0PP4  chemical  protective  clothing  while  minimizing 
possible  contaminating  effects  of  long  duration  sustained 
operations.  The  approach  was  to  test  each  of  two  groups  of 
Stinger  teams  under  conditions  of  HOPPO  and  M0PP4.  The  two 
groups  differed  widely  in  training  and  experience.  The  low 
experience  group  consisted  of  twelve  teams  recruited  during  their 
last  week  of  advanced  individual  training.  This  group  had  been 
qualified  on  the  Stinger  weapon,  on  visual  aircraft  recognition, 
and  had  received  9  hours  of  instruction  in  MOPP.  The  high 
experience  group  consisted  of  twelve  teams  recruited  from 
veterans  newly  returned  from  Operations  Desert  Shield  and  Desert 
Storm.  In  addition  to  individual  and  unit  training,  this  group 
had  received  1  hour  of  MOPP  training  every  day  for  7  months  while 
in  Southwest  Asia.  Both  experience  groups  were  tested  according 
to  the  same  methods  and  procedures  in  the  Range  Target  System 
engagement  simulation  facility.  No  team  in  either  group  spent 
more  than  3  hours  in  M0PP4.  Measurements  were  recorded  for 
engagement  performance,  stress,  and  workload. 


Findings: 

The  engagement  performance  of  Stinger  teams  was  poorer  when 
wearing  M0PP4  than  when  wearing  MOPPO  for  both  experience  groups. 
Analysis  of  these  results  suggests  that  the  performance 
degradation  seen  in  M0PP4  was  attributable  to  the  properties  of 
the  gas  mask.  Engagement  performance  was  better  for  the  high 
experience  group  than  for  the  low  experience  group  regardless  of 
MOPP  condition.  Reported  stress  and  workload  ratings  were  higher 
when  Stinger  teams  wore  M0PP4  than  when  they  wore  MOPPO. 
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utilization  of  Findings: 


The  results  of  this  research,  as  a  final  test  report  plus 
data,  were  provided  to  the  Physiological  and  Psychological 
Effects  of  the  Nuclear,  Biological,  and  Chemical  Environment  and 
Sustained  Operations  on  Systems  in  Combat  (P^NBC^)  program. 
Performance  decrement  data  such  as  these  are  integrated  into  the 
P^NBC^  database  for  eventual  incorporation  into  the  Performance 
Assessment  Model.  Results  of  P^NBC^-sponsored  tests  are 
periodically  published. 
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STINGER  TEAM  FERFORMANCE  DURINS  ENGS^GOtENT  OFERATIGNS  IM  A 
CHEMICAL  ENVIRONMENT:  IHE  EFFECT  OF  EXPERIENCE 


Background 

The  adverse  effects  of  wearing  the  Mission  Oriented  Protective  Posture 
(MOPP)  ensemble  and  the  detrimental  consequences  on  performance  are  well 
documented.  The  literature  from  1980  to  1988  dealing  with  the  effects  of  the 
chemical  protective  ensemble  and  extended  cperations  on  performance  was 
summarized  by  Headley,  Brecht-Clark,  Feng,  and  Whittenburg  (1988) .  Their 
review  included  mostly  laboratory  and  small-scale  field  teste  involving 
infantry  pserforming  sustained  operations  in  tenperate  climates  and  moderate 
terrains. 

Based  on  their  review,  Headley  et  al.  (1988)  arrived  at  several 
conclusions.  They  determined  that  comraunication  in  MOPP  gear  can  be 
difficult,  and  that  this  difficulty  is  exacerbated  by  distance  and  noise.  The 
authors  further  observed  that  soldiers  will  devise  new  ways  to  perform  their 
tasks  to  overccme  the  effects  of  the  chemical  protective  ensemble.  They 
maintain,  therefore,  that  training  in  MOPP  gear  is  essential  to  prevent 
soldiers  from  using  the  battlefield  as  a  place  to  inprovise  ways  to  carry  out 
their  duties.  The  reviewed  studies  provided  evidence  that  practice  in  MOPP 
gear  can  reduce  some  of  the  performance  decrements,  specifically  those 
associated  with  fine  motor  skills.  Ultimately,  according  to  Headley  et  al., 
most  tasks  can  be  performed  in  the  MOPP  ensenble,  but  cotpletion  times  may  be 
longer. 


The  performance  decrements  in  M0PP4  described  by  Headley  et  al.  (1988) 
can  result  from  a  variety  of  factors  such  as  loss  of  manual  dexterity, 
degradation  of  reaction  time,  deterioration  of  psychomotor  skills,  inpairment 
of  speech  intelligibility,  and  reduction  of  the  visual  field.  In  seme  cases, 
it  has  been  found  that  a  particular  pieca  of  the  MOPP  ensentole  is  direcbly  and 
often  times  solely  responsible  for  the  observed  performance  decrement.  For 
instance,  the  mask  and  hcxxl  worn  as  part  of  the  MOPP  gear  is  known  to  degrade 
vision  and  speecdi  functions  (Bensel,  Teixeira,  &  Kaplan,  1987;  Harrali,  1985; 
Kobrick  &  Sleeper,  1986;  and  Nixon  &  Decker,  1985) . 

One  investigation  (Heunrah,  1985)  of  the  effect:  of  mask  and  hcxxl  on 
performcince  examined  visual  performance  using  three  prototype  XM40  protective 
masks  in  cernbination  with  M19  binoculars.  Harrah  recorded  the  field  of  view 
with  each  binexulctr-mask  combination  and  the  standoff  distance  from  the 
soldier's  eye  to  the  mask  lens  to  explore  their  relationship  to  seen  time 
performance.  He  found  that  mecin  field  of  view  decreased  linecurly  cis  standoff 
distance  increased.  The  decreased  field  of  view  resulted  in  an  increase  in 
the  time  reejuired  to  seen  the  target  area. 

The  elements  of  the  M0PP4  ensemble  (suit,  gloves,  boats,  and  mask)  cen 
ac±  alone  or  in  conc^ert  to  impede  body  mobility,  psychemotor  exxardination,  and 
manual  dexterity.  While  gloves  generally  make  the  greatest  exantribution  to 
the  performaiTce  deenrement  for  teste  of  manual  dexterity  (Bensel,  1980;  Bensel, 
et  al.,  1987;  Johnson  &  Sleeper,  1986),  reduced  bcxdy  mobility  and  impeded 
psychomotor  eexardination  can  result  from  various  exambinations  of  the 
exmponente  of  the  protective  ensemble  (Bensel,  et  al.,  1987). 
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Althou^  serious  problems  are  associated  with  wearing  MDPP  geeir,  the 
effects  of  the  chemical  protective  ensemble  are  different  d^jending  the 
task  being  performed.  Some  studies  (e.g.,  Posen,  Munro,  Mitchell,  & 
Satterthwaite,  1986;  U.S.  Air  Force  Tactical  Warfare  Center,  1981;  and  Glumm, 
1988)  have  shown  that  performance  in  M0PP4  did  not  differ  significantly  from 
performance  in  MOPPO.  In  addition,  they  have  also  shewn  that  even  when  M3PP4 
performance  is  degraded,  in  some  cases  it  is  still  well  within  military 
standards. 

On  9  May  1984  the  Army  Vice  Chief  of  Staff  directed  that  a  program  be 
initiated  to  assess  the  Physiological  ard  Psychological  Effects  of  the 
Nuclear,  Biological, _and_Chemical  Environment  and  Sustained  Operations  on 
Systems  in  Combat  (P'^NBC'^) .  objectives  of  this  program  are  to  (1) 

quantify  the  crew  performance  decrement  experienced  during  operations  on  the 
integrated  battlefield;  (2)  determine  how  the  decrement  affects  Airland  Battle 
doctrine;  (3)  identify  methods  and  procedures  to  reduce  the  decrement — 
including  doctrine,  training,  organization,  and  materiel  changes;  (4) 
integrate  performance  decrenvent  data  into  a  database;  and  (5)  develop  and 
validate  a  Performance  Assessment  Model.  Results  of  P^NBC?-sponsored  tests 
are  being  used  to  provide  planning  and  operational  risk  factor  analyses  to 
field  commanders,  to  support  the  developnent  of  training  programs,  to  develop 
doctrine  and  organization,  and  to  influence  the  design  and  acquisition  of 
materiel  to  improve  the  capability  to  conduct  successful  combat  operations  on 
a  battlefield  v^here  NBC  weapons  eire  extensively  and  continuously  enplqyed. 

The  United  States  Army  Research  Irxstitute  (ARI)  Fort  Bliss  Field  Unit 
is  conducting  a  program  of  research  on  Forward  Area  Air  Defense  (FAAD) 
performance  in  a  chemical  environment  under  the  auspices  of  the  FNBC^ 
program.  The  ART  program  addresses  the  P^IBC^  issues  of  performance 
degradation  and  psychological  effects  of  the  chemically  contaminated 
environment  by  testing  air  defense  soldiers  in  MOPPO  and  M0PP4  under  different 
environmental  conditions.  Unlike  some  other  P^NBC^-funded  research  (c.f., 
Headley  et  al.,  1988) ,  this  program  does  not  investigate  the  effect  on 
performance  of  wearing  M0PP4  during  sustained  operations.  ARI  research 
participants  never  wear  the  chemical  protective  clothing  longer  than  three 
hours.  Rather,  the  focus  of  this  program  is  to  investigate  the  effects  on 
performance  of  the  M0PP4  clothing  itself,  separate  from  any  effects  caused  by 
extended  operations.  For  exanple,  Johnson  and  Silver  (1992)  investigated  the 
effects  of  M0PP4  gear  and  tcirget  cuing  on  aircraft  engagements  by  novice 
Stinger  teams.  They  found  engagement  performance  to  be  degraded  by  weeuring 
the  M0PP4  chemical  protective  ensemble  and  improved  by  the  addition  of  precise 
visual  cues.  Use  of  these  cues  substantially  reduced  the  degradation  due  to 
wearing  MDPP4.  That  is,  the  M0PP4  clothing  itself  degraded  the  performance  of 
the  novice  Stinger  teams — independent  of  any  effect  of  sustained  operations — 
and  the  addition  of  cues  restored  most  of  the  loss.  In  addition.  Stinger 
teams  reported  higher  stress  and  workload  levels  in  M0PP4  than  in  MOPPO 
vtiether  or  not  they  were  receiving  visual  cues. 
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Ihis  paper  reports  the  results  of  another  short-duration  investigation 
of  the  effects  of  wearing  the  chemical  protective  ensemble  on  Stinger  team 
engagement  performance.  As  stated  above,  one  of  the  conclusions  drawn  by 
Headley  et  al.  (1988)  was  that  practice  in  MOPP  gear  can  reduce  seme  of  the 
performance  decrement  attributed  to  weciring  MOPP  gear.  The  resecunch  questions 
addressed  in  this  ejqseriment  were  these.  To  v^t  extent  is  Stinger  team 
performance  harmed  by  weeiring  M0PP4?  Is  Stinger  team  performance  in  MDPP4 
iiiproved  by  extensive  ei^ierience  with  the  chemical  protective  clothing?  Ihe 
approach  was  to  measure  the  engagement  performance  of  each  of  two  groi^js  of 
Stinger  teams  both  vhile  dressed  in  the  standard  battle  dress  uniform  (MOPPO) 
and  v^iile  wearing  the  standard  uniform  plus  full  chemical  protective  clothing 
(M0PP4) .  The  two  groups  differed  substantially  in  their  relative  level  of 
ejqserience  with  MOPP.  Ihe  Low  Experience  Grotp  was  a  sanple  of  Stinger  teams 
from  Advanced  Individual  Training  (ATT) .  The  Hi^  Esqserience  Groi:p  was  a 
sairple  of  Stinger  teams  recently  returned  from  Operations  Desert  Shield  and 
Desert  Storm.  It  was  hypothesized  that  both  groins  would  shew  a  decrement  in 
engagement  performance  under  conditions  of  MDPP4  ard  that  the  Hi^  Ejqjerience 
Group  would  perform  better  than  the  low  Esqaerience  Groip  on  measures  of 
engagement  performance.  It  was  also  hypothesized  that  participants  would 
report  greater  levels  of  stress  and  workload  when  weatring  chemicail  protective 
clothing. 

It  should  be  noted  explicitly  that  the  independent  variable  "experience 
level"  was  not  manipulated  directly,  but  was  created  indirectly  by  recruiting 
test  participants  from  two  groups  vho  differed  widely  in  experience  in  M0PP4 
(i.e. ,  AIT  trainees  versus  Southwest  Asia  veterans) .  Ihe  Hi^  Experience 
Group,  therefore,  differed  from  the  Low  Experience  Groi:?5  in  several  ways, 
including;  Age,  rank,  time  in  service,  amount  of  Stinger  training,  amount  of 
Stinger  training  in  M0PP4,  and  total  amount  of  time  spent  wearing  M0PP4.  All 
results  attributed  to  experience  level  should  be  understood  in  li(^t  of  the 
opportunistic  nature  of  this  independent  variable.  Thus,  this  research  can  be 
viewed  as  an  attenpt  to  qucintify  the  relative  cost  in  readiness  of  earploying 
novice  Stinger  teams  versus  ej^rienced  Stinger  teams  in  a  chemical 
environment. 


Method 


Participants 

Low  Experience  Group.  IVelve  Stinger  teams  from  the  1st  Battalion,  56th 
Air  Defense  Artillery  (ADA)  Regiment,  6th  ADA  Brigade  served  in  this 
experiment  during  December,  1990.  Each  team  consisted  of  two  soldiers,  a  team 
chief  and  a  gunner.  The  Military  Occupational  Spjecialty  (MOS)  for  all 
soldiers  was  MANPADS  Crewmember  (16S).  The  mean  age  of  soldiers  was  19.0 
years  (median  18.0) .  All  24  participants  were  in  their  last  week  of  ATT  at 
Fort  Bliss,  Texas.  All  had  been  qualified  on  the  Stinger  weapon  and  in  visual 
aircraft  recognition.  All  participants  had  completed  nine  hours  of  MOPP 
training  during  AIT,  of  which  three  hours  were  dedicated  to  engagement 
training. 
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HlcAi  ExpeTnenae  GrouD.  OXielve  Stinger  teaans  frcn  the  5th  Battalion, 

62ncl  AEA  Ragiment,  Uth  AEA  BrigzKle  served  in  this  eoqjeriment  during  April  and 
May,  1991.  Each  team  consisted  of  two  soldiers,  a  team  chief  and  a  gunner. 

Ihe  M3S  for  all  soldiers  was  16S.  Ihe  mean  age  of  soldiers  was  22.6  years 
(median  23.0) .  Ihe  mean  and  median  rank  of  soldiers  was  CPL.  All  24  soldiers 
had  just  returned  from  Southwest  Asia  vhere  they  had  participated  in 
Operations  Desert  Shield  and  Desert  Storm.  All  soldiers  had  received  either 
M3EP  training  or  operational  experience  in  M3FP  for  at  least  one  hour  every 
day  for  the  seven  months  they  were  stationed  in  Southwest  Asia. 

Ihe  Stinoer  Weapon 

Stinger  is  a  man-^rtable  air  defense  weepon  system.  It  is  a  shoulder- 
fired,  infrared-homing  (heat-seeking)  guided  missHe.  Stdng^  reqpjLires  no 
control  from  the  gunner  arfter  firing.  It  has  an  identification  friend  or  foe 
(IFF)  subsystem  vhich  electronically  interrogates  target  zdrcraft  to  establish 
friendly  identification.  Stinger  provides  short-range  eiir  defense  for 
maneuver  vnits  and  less  mobile  combat  support  units.  Stinger  is  designed  to 
counter  hi^-speed,  low-level,  ground-attacik  cdrcraft.  It  is  also  effective 
against  helicopter,  observation,  and  transport  aircraft  (Field  Manual  NO.  44- 
18-1,  1984). 

Gunners  maint2dn  proficiency  by  practicing  with  the  Stinger  Training  Set 
Guided  Missile  (M134) .  Each  training  set  consists  of  a  traciking  head  trainer, 
five  rechargeable  batteries,  an  IFF  simulator,  and  a  storage  ocntainer.  Ihe 
Stinger  traciking  head  trainer  (mr)  simulates  the  actual  live  Stinger  rcund  in 
size,  shape,  weight,  and  feedback  from  engagement  actions — except,  of  course, 
no  missile  is  laundied.  Ihe  seeker  head  inside  the  IKT  is  the  same  seeker 
head  as  inside  the  live  missile.  Thus,  its  audio  feedback  to  the  gunner  vhile 
tracking  the  heat  source  of  an  aircraft  is  the  same.  Ihe  IFF  simulator 
imitates  the  actual  IFF  subsystem  in  size,  wei^t,  cabling  requirements,  and 
provides  the  same  audio  feedback  to  the  gunner.  Ihe  Training  Set  Guided 
Missile  was  the  weapon  used  during  this  research. 

Additional  Fmntxnent 

All  soldiers  wore  the  standard  battle  dress  imiiform  plus  pistol  belt, 
load  bearing  equipment,  canteen,  and  kevlar  helmet  during  the  N3PP0  condition. 
During  the  MDFP4  condition  eill  of  the  above  items  were  worn  plus  the  chemical 
protective  clothing.  The  chemical  protective  cd.othing  consisted  of  gloves, 
overboots,  overgarments  (worn  cd.osed) ,  and  M40  mask  and  hood  (worn  closed) . 

In  addition,  each  team  chief  carried  a  set  of  7  x  50  binoculars  (M19) . 
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rtesfTrintiori.  Air  defense  perfarmanoe  data  were  collected  in  the  Range 
Target  System  (RTS) ,  a  EAAD  engagement  simulatiGn  facility.  Air  defenders 
enplcy  their  weapons  in  siaulated  engagement  of  subscale  fixed-wing  and 
rotary-wing  aircraft.  RX5  is  located  in  the  desert  near  CScndron  Amy  Airfield 
at  Nhite  Sands  Missile  Range,  New  Mexico.  RTS  is  the  third  fAAD  simulation 
facility  developed  by  the  USARI  Port  Bliss  Field  Unit,  hairing  evolved  from  the 
Realistic  Air  Defense  Engeigement  System  (RAEES)  circa  1984-1985,  and  the 
multiple  weE$)on  RAEES  (MRACES)  circa  1986-1989.  RTS  has  been  operational 
since  1989.  Detedls  as  to  the  validation  of  this  simulation  facility  can  be 
found  elsewhere  (Barber,  1990a;  Drewfs,  Barber,  Johnson,  &  Fredericikson,  1988; 
Johnson,  Barber,  &  looldiart,  1988) .  To  date,  Vulcan,  PIVADS,  Chaparral, 
Stinger,  and  Avenger  imits  have  engaged  aiircraft  in  RTS. 

RTS  uses  subscale  rotary-wing  (helicopter)  and  fixed-wing  (adrplane) 
targets.  All  targets  represent  US  or  Soviet  cdrcraft.  Aircraft  are 
camouflaged,  three  dimensional,  molded  fiberglass  replicas.  Ihey  are  either 
flown  remotely  according  to  prescribed  fli^t  paths  and  maneuvers,  or  pcp-i:p 
from  designated  positions  via  pneumatic  stand-lift  nechanisns.  Ihe  flying 
fixed-wing  (fW)  aircraft  are  remotely  controlled  by  radio  signals  from  e}^)ert 
pilots  stationed  in  the  test  range.  Ihe  pop-ip,  rotary-wing  (RM)  targets  are 
positioned  strategically  b^iind  sand  dunes  at  scenario  prescribed  distances. 
Flying  edrcraft  are  tradked  by  a  laser  position-location  ^stem.  All 
edrcraft  are  fitted  with  a  heat  source  vMch  stimulates  the  infrared-radiation 
seeker  of  heat-acquiring  missile  systems  such  as  Chaparral,  Stinger,  and 
Avenger. 

Air  defense  weapons  are  transpoi^ed  to  the  RTS  site  and  emplaced  in  a 
battle  position.  Weapons  are  cabled  to  the  Data  Acquisition  Station  (DAS)  and 
signal  t^^  are  installed  on  veapon  pins.  The  DAS  interrogates  the  we^xn 
every  250  milliseconds  to  see  if  a  gunner  action  has  occurred.  Gunner 
engagement  actions  are  thus  collected  autcmatically  and  time  coded  with  a 
resolution  of  250  milliseconds.  Team  chief  verbal  actions,  such  as  detection 
and  identification,  are  recorded  by  a  human  data  collector  vdio  fibers 
keystrokes  on  a  cooputer  ke;^3oard  located  at  the  weeqpon  position.  The  DAS 
interrogates  this  keyboard  every  250  milliseconds  to  see  if  a  verbal  action 
has  occurred.  In  this  fashion  gunner  and  team  chief  engagement  actions  are 
entered  into  the  trial  database  along  with  a  time  code — time  in  seconds  from 
target  avedlability — ^and  a  range  code — ^range  of  target  aircraft  in  kilometers 
from  fire  unit.  Thus,  at  the  end  of  each  oigagement  trial  a  conplete  record 
of  cdl  engageoaent  actions  executed  by  the  team  is  obt^dned.  This  record  is 
mathematically  processed  in  near  real  time  and  is  available  in  the  form  of 
feedback  a  few  seconds  after  the  termination  of  each  scenario  trial.  When  a 
Stinger  gunner  fires,  a  mathematiccil  model  synthetically  flies  the  missile  out 
to  known  target  position  for  target  intercept  (or  miss)  in  reed  time.  In  this 
fashion  the  effects  of  a  occplete  engagement  can  be  determined  ("Vin"  or 
’♦miss”)  without  necessitating  the  dangers  or  expeansa  of  live  fire. 


Bie  primary  oonpcnents  of  the  Range  Target  ^^stem  are  the  Flyirg  Target 
System  (FIS) ,  the  Pqp-Cp  Target  System  (PES) ,  the  Range  Cdtitrol  Station  (RCS) , 
the  Data  Aog^iticn  Station  (OAS) ,  and  the  Position  Location  Station  (FIS) . 
The  RCS,  EAS,  and  PIS  ocmponerits  are  desorihed  in  greater  detail  in  Barber 
(199Qb) .  The  ns  and  FIS  ocmponents,  respectively,  are  described  more  fully 
in  Berry  and  Barber  (1990a&b) .  The  FIS  presents  flying,  sccde  models  of 
fixed-wing  and  rotary-wing  edrcraft.  In  this  esqperiment,  the  FES  presented 
ane-sevsith  scale  IW  mnAais  of  the  US  A-7  and  A-10,  eis  well  eis  the  Soviet  Su- 
20/22  and  Su-25.  The  ETS  presents  one-fifth  scale  mcxiels  of  rotary-wing 
aircTcift.  helicopters  pop-i;p,  pneumatically,  from  defilcKie,  hover  for  a 

sriPTwH n-gpuTj-i  f i period  of  with  the  rotor  turning,  and  then  descend. 
Each  FIS  is  ccoputer  controlled  hy  radio-fireguency  instructions  sent  fixm  the 
RCS.  The  FW  models  lased  in  this  e^gieriment  were  the  AH-1,  AH-64,  UH-1,  Mi-8, 
Mi-24,  and  Mi-28. 

The  RCS  is  the  station  «here  voice  occnunications,  system  test  and 
calibration  checks,  initialization  of  the  system,  real-time  functions, 
performance  scoring,  and  printing  of  feedback  are  initiated.  Oontrol  of  the 
Range  Target  System  during  scenario  presentation  is  located  at  the  RCS.  The 
DAS  cc^Ttures  all  of  the  team  chief  and  gunner  engagemmit  task  performance  and 
wecpcxi  events  as  a  function  of  elapsed  time  and  cdrcrEift  range.  Effects 
scoring  and  assessment  of  kills  cune  also  performed  at  the  DAS.  The  DAS 
provides  scenario  feedback  on  these  events.  During  testing  of  the  Low 
E}^)erience  Group  there  were  two  separated  we^xxi  positioais,  each  with  its  cwn 
DAS  and  data  collector.  During  testing  of  the  High  Experience  Group  there 
were  four  separated  weapon  positions  each  with  DAS  and  data  collector.  All 
DASs  are  controlled  ty  the  RCS  and  ocmmunicate  with  the  RCS  by  radio.  Prior 
to  each  trial,  scenario  information  is  dcwn-loaded  from  RCS  to  DAS.  After 
each  trial,  engagement  data  are  t^loaded  from  DAS  to  RCS.  The  PIS  is  I'sed  to 
register  (ground  locate)  the  weapon,  the  pop-ip  heliccpter  stands,  flying 
target  launch  positions,  as  well  as  the  other  RTS  stations  (RCS,  DAS,  and 
PIS) .  Also,  it  is  used  to  track  flying  taurgets  and  determine  their  range 
thrcxi^iout  a  scenario.  The  FIS  is  accurate  to  within  one  meter  in  three 
dimensional  space.  The  FIS  can  automatically  detect,  acquire,  and  track 
flying  targets.  It  can  also  be  operated  manually  using  its  video  di^lay  and 
tracWaeill. 

Measures  of  performance  obtained  from  RES.  The  Stinger  teams  were 
evaluated  on  the  timeliness  of  their  engagement  actions.  When  or  how  quickly 
did  the  teams  perform  their  tasks?  This  efficiency  of  engagemait  was 
determined  by  the  fourteen  Task  Performance  Measures  defined  in  Table  1.  Task 
Performance  Measures  (TFMs)  were  collected  on  a  trial-by-trial  basis.  These 
measures  describe  the  time  elepsed  or  the  target  edrcxeift  range  vhen  specific 
engagement  actions  were  performed.  For  fixed-wing  aircraft  these  TEMs  are 
expressed  in  terms  of  the  edreraft  range  in  full-scale  kilemeters  vhen  the 
engagement  actions  oocurred  (e.g. ,  detection  range,  identification  range,  fire 
range) .  Since  RTS  aircraft  are  subscale,  cd.1  ranges  are  presented  in  terms  of 
full-scale  range  equivalents  by  rultiplying  the  measured  range  by  the  scaling 
factor.  For  rotary-wing  edreraft,  TEMs  are  expressed  in  terms  of  the  elapsed 
time,  in  seconds,  between  two  engagement  actions  (e.g. ,  time  from  target 
avadlable  to  detect,  time  from  detect  to  identify,  time  &xm  identify  to 
fire). 
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The  Stinger  teams  were  also  evaliiated  cn  the  effectiveness  of  their 
engagement  actions,  fttiat  mission-related  outoomes  resulted  from  their 
actions?  This  effectiveness  of  engagaoent  was  calculated  by  the  eic^  Sunnaxy 
Performanne  Measures  defined  in  Table  2.  Sunnazy  Perfannanoe  Measures  (SIMs) 
are  derived  from  ta^  actions  by  sunming  across  trials.  SIMs  are  ej^iressed  in 
terms  of  percentages  (e.g.,  percent  edrcraft  detected,  percent  hostile 
eiircraft  carrectly  identified,  percent  hostile  eurcraft  attrition) . 

Procedure 


The  schedule  of  data  collection  activities  is  presented  in  Thble  3. 
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liable  1 


Ta^  Perf czxDanoe  Measures 


Fixed-Wim  Aircraft 

Detection  Range:  Range  of  alxtxaft  (in  full*scede  kilcneters)  at  detect 
response  ("target") 

Identification  Range:  Range  of  edrcraft  at  identification  response  (tactical 
ID  "hostile"  or  "friendly") 

IFF  Range:  Range  of  edrcraft  at  push  of  IFF  button 

Acquire  Range:  Range  of  zdxcraft  at  weepon  acquisition  signal 

locik-On  Range:  Range  of  edrcraft  at  press  of  uncage  bar  (viuch  locks  seeker 
onto  target) 

Fire  Range:  Range  of  edrcraft  at  fire  (trigger  pull) 


Rotarv-Winc  Aircraft 

Time  from  Target  Avedlable  to  Detect:  Time  (in  seconds)  fron  instrument 
record  of  target  etvailable  until  detect  res^xxise  (target 
avedlable  is  defined  as  that  time  when  the  target  has  risen 
far  enough  to  be  visible  from  the  weapon  positions) 

Time  from  Detect  to  IFF:  Time  from  detect  re^xnse  to  push  of  IFF  button 

Time  from  Detect  to  Identify:  Time  from  detect  response  to  idmitification 
response 

Time  from  Detect  to  Acquire:  Time  from  detect  response  to  \riecpon  acquisition 
signal 

Time  ^xm  Acquire  to  Icck-On:  Time  from  veapan  acquire  signal  to  press  of 
uncage  bar 

Time  from  Lock-On  to  Fire:  Time  from  press  of  uncage  bar  to  fire  (trigger 
pull) 

Time  from  Identij^  to  Fire:  Time  from  Identification  re^xxise  to  fire 

Time  from  Detect  to  Fire:  Time  from  detect  response  to  fire 
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Table  2 


Sunnazy  Performanoe  Measures 


Feroent  Airca:^dft  Detected:  NUniser  of  aircraft  fcr  %Aiich  a  detect  response  is 

givai,  divided  by  the  total  number  of  aircraft 
presented 

Percent  Aircraft  Correctly  Identified:  Number  of  edrcraft  for  vbicii  a  correct 

ID  response  is  given,  divided  by  the  total  nunber 
of  aircraft  detected 

Percent  Hostile  Aircraft  Correctly  Identified:  Nunber  of  hostile  edrcraft  for 

vbich  a  correct  ID  response  is  given,  divided  by 
the  total  nunber  of  hostile  cdrczaft  detected 

Percent  Friendly  Aircratft  Correctly  Identified:  Nunber  of  friendly  edrcraft 

for  vbich  a  correct  ID  response  is  given,  divided 
by  the  total  number  of  friendly  edrcraft  detected 

Percent  Hostile  Attrition:  Number  of  hostile  aircraft  credited  as  killed, 

divided  by  the  total  number  of  hostile  edrcraft 
presented 

Percent  Fratricide:  NUnber  of  friendly  aircraft  credited  as  killed,  divided 

by  the  total  nunber  of  friendly  cdrczaft  presented 

Percent  Hostiles  Killed  Prior  to  Ordnance  Release:  Number  of  hostile  aircraft 

credited  as  killed  prior  to  ordnance  release, 
divided  by  the  total  nunber  of  hostile  aircraft 
presented  (Ordnance  release  is  defined  as 
sf^proaching  vdthin  two  kilometers  of  weapon 
position  for  fixed-wing  adrcxaft.  Ordnance 
release  is  defined  as  20  seconds  after  target 
availability  for  rotary-wing  aircraft.) 

Ccxiditional  Probability  of  Kill  Given  Fire  (eapressed  in  percent) :  Nunber  of 

aircraft  credit^  as  killed  (hostile  plus 
fin.endly) ,  divided  by  the  total  nunber  of  fire 
events  (trigger  pulls) 
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T^le  3 

Schedule  of  Data  CJoUectlcn  Activities 


Stinger  Low  Experience  Group 


AH: 

9  P9Q 
MOFFO 

9  PSS 

M3PP4 

2Q-PSS 

M3FP0 

EM: 

H3PP4 

M3PP0 

M3PP4 

AH: 

isjes 

M3PP4 

3,6  .p$g 
H3FF0 

IT-D^ 

H3PP4 

EM: 

H3PP0 

M3PP4 

MOFFO 

stinger  Hlcfti  Experience  Group 


30  Apr  1  May 
AH:  M3PP4  H3PP0 
EM;  MOPPO  M3EP4 


?-MaY 

M3PP4 

M3CP0 


AM  =  0900-1200  hrs 
EM  =  1300-1600  hrs 


Field  testing.  Ihe  ATT  personnel  vev&  tested  in  the  EOS  during  their 
last  week  of  txaining.  They  were  brought  to  the  RIS  site  by  an  instructor  vho 
in  no  way  interfered  with  the  test  or  coached  then  during  the  test.  The 
Southwest  Asia  veterans  were  brought  to  the  site  by  USARI.  When  participants 
reported  either  to  the  test  site  or  to  the  transportation  pick-ip  point,  USARI 
personnel  briefed  them  in  detail  on  the  research,  their  roles  in  it,  and  the 
^jecific  tasks  they  would  perform.  An  outline  of  the  briefing  given  to 
participants  is  provided  in  i^ipencLix  A.  All  personnel  were  menbers  of 
preexisting  teams.  Teams  determined  their  own  individual  duty  assignments 
(i.e. ,  team  chief  or  gunner) .  Teams  were  assigned  to  wbc^xxi  positions. 

Typically,  a  new  ATT  graduate  would  not  be  a  team  chief.  For  purposes 
of  this  eaq^eriment,  ha«ver,  leader-gunner  teams  were  a  requirement.  So 
trainees  were  chosen  as  "acting"  team  leaders.  This  did  not  prove  to  be  a 
problem,  prooedurally,  since  the  trainees  were  knowledgeable  and  eager  to 
perform  as  team  chiefs. 

Once  at  a  Meapan  position,  each  data  collector  reviewed  the  engagement 
actions  with  his  team  and  shewed  them  their  sector  of  responsibility,  left 
limit,  ri^t  limit,  and  primary  target  line  (ETL) .  Each  team  was  responsible 
for  defending  the  same  90  degree  search  sector.  Procedures  were  enplqyed  to 
ke^  all  wec$)on  positions  visually  and  aurally  independent  of  one  another  to 
prevent  cross  cuing. 
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Each  tiwin  received  13  data  trials  imder  ocnditions  of  MDFIPO  aiid  13  under 
HDFP4.  M3PP0  airl  MDFP4  trials  occurred  in  a  grocqp  either  during  the  morning 
or  during  the  aftemocn.  Ihe  schedule  of  MDPPO  and  N3CP4  trials  was 
oountezhEdanced  acroes  days  of  the  e:q)erinient  as  ponesented  in  Table  3.  Prior 
to  each  morning  aiftemoon  session  a  preu^tioe  trial  was  run  %hich  contained 
both  a  fixed-wing  and  a  rotary-wing  aircraft.  Participants  received  feedback 
on  their  performance  at  the  end  of  the  day  eifter  they  finished  both  the  ICFPO 
and  the  M3PP4  sessions. 

Ihe  game  13  scenarios  were  presented  to  all  teams  both  in  the  N3PP0  and 
the  10PP4  sessions — but  in  a  different  counterbalanced  order.  The 
counterbalanced  ordering  of  scenario  presentations  varied  both  across  sessions 
within  a  day  and  across  test  days.  The  counterbalancing  scheme  was 
constrained  by  the  practicEd  necessity  not  to  have  two  fixed-wing  trials  back- 
to-back  (i.e.,  to  save  pr^)aration  time).  The  13  test  scenarios  are  described 
in  Table  4.  These  13  scenctrios  presented  the  participating  teams  with  a 
variety  of  aircraft  targets.  Scenarios  varied  in  edrcraft  type,  intent, 
model,  number  of  cdrcraft  per  scenario,  range,  aspect  angle,  edrcraft  ingress 
azimuth,  duration  of  availability,  and  level  of  difficulty. 

All  data  were  collected  during  Weapons  Ocntrol  Status  Ti^it.  This  meant 
that  soldiers  were  required  to  matoe  their  tactical  idaitification  based  v:pon 
visucil  criteria  (e.g. ,  Soviet  aircraft  were  hostile,  US  Eurcxaft  were 
friendly) .  All  trials  were  aderted. 

Each  trial  began  vhen  the  data  collector  gave  the  team  a  veibal  alerting 
message.  This  message  stated  that  edr  activi^  was  imminent  and  reminded  the 
team  of  their  Weapons  CJontrol  Status  (i.e.,  '•Bedi  Tic^t!").  The  data 
collector  verbally  signalled  the  end  of  a  trial  by  alerting  the  team  that  the 
current  air  attack  had  subsided  ("Return  to  C3ondition  Yellcw.") .  Each  team 
was  instructed  in  the  discrete  trial  procedure  enplcyed  and  reminded  of  the 
trial-begin  and  trial-end  signals. 

Soldiers  ccnpleted  stress  and  workload  questionnaires  as  part  of  field 
testing.  The  stress  questionnEdre  (Self-Eveduaticn  QuesticnnEdre, 

Spielberger,  1983)  was  administered  twice  during  each  session— cnce  j\]st  prior 
to  beginning  and  agEdn  just  after  fini^dng  each  session.  The  workload 
questionnaire  (TIX  Rating  Scales,  NASA-Ames,  1986)  was  administered 
immediately  after  each  data  tried  during  both  MOPPO  airi  M0PP4  sessions. 


Table  4 


Test  Soenario  ^)eclf icaticns 


Seen. 

NO. 

A.C. 

a. 

Degrees 

m 

Pres. 

Sec. 

Level  of 

No. 

Targ. 

lype 

Intent  Model 

AZ. 

Aspet± 

Range 

Order 

Avail. 

Diff. 

01 

F 

AlO 

11 

45 

** 

Medium 

02 

F 

A7 

1 

45 

** 

Medium 

03 

1 

IW 

H 

Su25 

11 

45 

** 

Medium 

04 

1 

IW 

H 

SU20/22 

1 

45 

** 

Medium 

05 

2 

Mix 

H 

Su25 

12 

0 

** 

Siaul 

— 

Hi^ 

H 

Mi24 

12 

90 

3.5* 

Sisul 

50 

Hi^ 

06 

1 

NW 

F 

UHl 

11 

270 

3.5* 

50 

Low 

07 

1 

PW 

F 

AHl 

12 

315 

3.5* 

50 

low 

08 

1 

PW 

F 

m64 

1 

90 

3.5* 

50 

Low 

09 

1 

m 

H 

Mi28 

11 

315 

3.5* 

50 

Low 

10 

1 

m 

H 

Mi24 

12 

90 

3.5* 

50 

Low 

11 

1 

PW 

H 

Mi8 

1 

45 

3.5* 

50 

Low 

12 

3 

PW 

F 

um 

11 

270 

3.5* 

Simil 

100 

Hi^ 

PW 

F 

AHl 

12 

315 

3.5* 

Simul 

100 

High 

PW 

F 

AH64 

1 

90 

3.5* 

Siaul 

100 

Hi^ 

13 

3 

PW 

H 

Mi28 

11 

315 

3.5* 

Siimil 

100 

Hi^ 

PW 

H 

Hi24 

12 

90 

3.5* 

Sirul 

100 

Hi^ 

PW 

H 

Mis 

1 

45 

3.5* 

Simul 

100 

Hi^ 

**  Target  beocmes  available  for  engagement  at  a  range  of  at  least  16 
kilcmeters.  Target  is  within  team's  search  sector  but  outside  visual 
detecticn  range.  Target  flies  an  ingressing  pattern  until  reaching  one 
kilcmeter  frcn  team,  then  turns  and  flies  bade  to  base. 

*  Target  rises  fraai  stationary,  defilade  position  to  beocme  avcdlable  for 
engagement,  hovers  for  predetermined  nunher  of  seconds,  then  returns  to 
defilade  position. 
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Die  pznoedure  followed  during  a  data  trial  %fiis  tills: 

•  Data  collector  shouts  alert. 

•  Team  nenhers,  sitting  %rLth  their  backs  to  the  range  between  trla^, 
stand  and  take  their  positions— gunner  shoulders  Stinger  iihile  team  chief 
searches  sector  for  aircraft. 

•  Upon  detection  of  aircraft,  team  p^onns  standard  tactic^ 
engcigenent  sequence  including  chief  using  binoculars  to  identic 
aircraft — if  a  nultiple  target  scenario,  the  engagement  sequence  is  repeated 
anew  for  each  target. 

e  Team  seauxhes  sector  for  aircraft  until  data  collector  shouts  reduced 
alert  status. 

•  Gunner  returns  Stinger  to  rack. 

•  Team  menbers  return  to  seats  at  veapan  position. 

•  Finally,  team  chief  and  gunner  ccoplerte  workload  questionnaire  for 
the  trial  just  finished. 

At  the  end  of  the  test  day,  cifter  all  trials  and  feedback,  soldiers  were 
given  an  outbrlefing.  (Time  constraints  prevented  some  soldiers  from  being 
interviewed.)  During  this  informal  interview,  both  team  chiefs  and  gunners 
were  given  an  opportunity  to  eoqpress  their  cpinicns  ocnoeming  the  M0FP4 
clothing  itself  and  their  problems  attenpting  to  engage  edrcraft  iihile  dressed 
in  this  clothing.  The  results  of  these  interviews  plus  observations  by  USARI 
test  personnel  are  presented  in  J^^pendix  B. 

The  design  of  this  eaqaeriment  was  a  mixed  factorial  with  two  levels  of 
the  M)FP  factor  (0  and  4)  and  two  levels  of  the  experienx  factor  (lew  and 
high) .  The  ICPP  factor  was  a  within  subjects  manipulation,  with  all 
participants  receiving  both  the  MDPPO  and  the  M0FP4  conditiens.  Ihe 
experience  factor  was  a  between  subjects  manipulaticn,  with  cLLl  participants 
in  the  Low  Experience  Gnxp  being  ATT  trainees  and  edl  participants  in  the 
Hi^  Experience  Grocp  being  veterans  newly  returned  frem  Operatiens  Desert 
Shield  and  Desert  Storm. 

Hypotheses 

Air  defense  engagement  tasks  were  expected  to  be  performed  less  well 
under  oonditiens  of  )CFP4  vben  ooepared  to  the  WPPO  oonditions.  Air  defense 
engagement  tasks  were  exqpected  to  be  performed  better  by  the  Hi^  Experience 
Group  than  by  the  lew  Experience  Grexp. 

I%u±icipants  were  expected  to  report  greater  stress  during  the  ICFP4 
conditions  when  oenpared  to  the  MDPPO  oonditions.  Participants  were  also 
expected  to  report  greater  workload  during  oonditiens  of  wearing  HDFP4. 
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MMlltS 

Enoaoeanent  Perf ontianoe 

Data  far  fixechwing  Ta^  Perfanoame  Maasures  (e.g. ,  detection  range, 
identification  range,  etc.)  were  aggregated  across  FW  soeanarios  (Scenarios  1, 
2,  3,  4,  and  tte  FW  portion  of  5)  for  each  condition  for  each  team.  Data  for 
rotaiy-wing  Task  Perfarmance  Measures  (e.g. ,  time  frcm  target  av2dlable  to 
detect,  time  from  detect  to  IFF,  etc.)  were  aggregated  across  FW  scenarios 
(Scenarios  6,  7,  8,  9,  10,  11,  and  the  first  FW  detected  in  Scenarios  12  and 
13)  for  each  condition  for  each  team.  Scores  for  each  Task  Performance 
Measure  were  aggregated  across  similar  soaeudos  (either  FW  or  FW)  by  taking 
the  arithmetic  mean  of  the  engagement  measures  recorded  in  FX5. 

Sunmary  Performance  Measures  (e.g. ,  percent  aircraft  detected,  percent 
aircraft  correctly  identified,  etc.)  were  calculated  over  relevant  scenarios 
for  each  condition  for  each  team.  For  eteanple,  FW  percent  edrcraft  detected 
was  calculated  over  Scenarios  1,  2,  3,  4,  and  the  FW  portion  of  5.  FW  percent 
cdrcraft  detected  was  calculated  over  Scenarios  6,  7,  8,  9,  10,  11,  12,  and 
13.  For  another  exasple,  FW  percent  fratricide  was  calculated  over  Scenarios 
1  and  2.  FW  percent  fratricide  was  calculated  over  Scenarios  6,  7,  8,  and  12. 
For  SPis  (but  not  TEMs)  all  three  targets  in  Scenarios  12  and  13  were 
included. 

Engagement  performance  was  analyzed  by  a  mixed  twc  factor  Analysis  of 
Variance  (ANCVA) .  The  within  subjects  factor  was  M3FP  level.  The  between 
subjects  factor  was  ejqjerienoe  level.  One  such  mixed  MXNh  was  performed  for 
each  of  the  measures  of  engagement  performanoe  using  the  SPSS/PO  Advanced 
Statistics  software  package  (Norusis,  1986,  pps.  8053-8181) .  Ihe  effect  of 
ejgjerience  was  tested  against  between-subjects  variability,  while  both  the 
M3PP  effect  and  the  esqierienoe  by  H3PP  interaction  effect  were  tested  eigeunst 
within-subjects  variability.  Due  to  the  relatively  small  samples  collected 
plus  the  notoriously  large  variability  ocimion  to  applied  field  research,  alpha 
probabilities  as  hi^  as  ten  percent  will  be  reported  for  the  engagement 
performanoe  results.  Due  to  the  large  number  of  measurements  recorded, 
results  (ranges,  times,  percentages)  and  analyses  (f-ratios,  B-vedues,  etc.) 
will  be  presented  in  detail  by  conditions  only  where  there  were  statistically 
significant  differences. 

Data  presented  in  tables  are  the  arithmetic  mean  (Mean) ,  the  standard 
deviation  (SQ) ,  and  the  number  Qi)  of  data  points  (i.e. ,  the  number  of  teams) 
upon  vhich  these  descriptive  statistics  are  based.  It  will  be  noted  that  the 
number  of  data  points  for  FW  targets  is  smaller  than  the  number  for  FW 
targets.  This  is  because  technical  difficulties  with  the  FIE  prevented  some 
teams  frcm  being  given  the  FW  scenarios.  No  make-^ups  were  possible  to  the 
ti^t  schedule  of  testing.  Ihe  difference  in  K  between  the  ATT  sample  and  the 
Southwest  Asia  sample  far  the  FW  scenarios  (10  versus  12)  reflects  a  loss  of 
data  for  two  teams  due  to  redn. 

Boults  for  fixecHfdna  aircraftt  Task  Perfarmance  MRaannag.  Positive 
ranges  are  inocming,  negative  ranges  are  outgoing.  Generally,  the  greater  the 
incoming  ranges,  the  better  the  performance.  Ihe  mean  detection  range  over 
all  conations  was  6.91  kilometers.  The  mean  overall  range  for  IFF 
interrogation  was  6.07  kilometers. 
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Table  5  presents  weapon  acxjulsition  range  for  the  eiircraft  as  a  function 
of  MDPP  level  and  e)^)erienoe  level.  Ihere  was  no  effect  of  MDPP  level  [Z(l, 
14)  *  0.16,  fi>.10].  Acquisition  range  was  significantly  greater  for  the  High 
Experience  Grocp  (3.65  kilometers)  than  for  the  Lew  £>q)erienoe  Grex;^  (1.55 
kilometers)  [Z(l,  14)  =  6.75,  e<.05].  aiiere  was  no  interaction  between  M3PP 
level  and  e}q)erienoe  level  [£(1,  14)  =  0.36,  £>.10]. 


Table  5 

Acquisition  Range  in  Kilometers  for  Fixed-Wing  Aircraft  ty  Oonditions 


lew  Esq^erience 
Statistic  MDPPO  M3PP4 


Hi^  E>q3erieice 
MDPPO  MDPP4 


Mean 

2.04 

1.07 

3.55 

3.75 

3.26 

2.88 

1.60 

2.03 

H 

8 

8 

8 

8 

Note. 

Positive  ranges  are 

incoming. 

Table  6  presents  identification  range  as  a  function  of  MDPP  and 
ejqierienoe.  Aircraft  were  identified  at  significantly  greater  range  under 
oonditions  of  MDPPO  (2.54  kilometers)  than  voider  conditions  of  MDPP4  (0.89 
kilometers)  [f(l,  14)  =  7.10,  £<.05].  Aircraft  were  also  identified  at 
significantly  greater  range  by  the  Hi^  EDq^erience  Grovqi  (2.81  kilometers) 
than  by  the  lew  E>q)erience  Grovq)  (0.61  kilometers)  [£(1,  14)  «  5.70,  £<.05]. 
Again,  there  was  no  interaction  between  MDPP  level  and  experience  [F(l,  14)  = 
0.01,  £>.10]. 


Table  6 

Identification  Range  in  Kilometers  for  Fixed-Wing  Aircraft  by  Conditions 


Lew  Esqierience 
Statistic  MDPPO  MDPP4 


Hi^  Experience 
MDPPO  MDPP4 


Mean 

1.45 

-  0.22 

3.63 

1.99 

SD 

2.33 

2.00 

2.15 

2.40 

N 

8 

8 

8 

8 

Note.  Positive  ranges  are  incoming;  negative  ranges  are  outgoing. 
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Tedsle  7  presents  the  range  at  weapon  lock-cn  as  a  function  of  H7FP  level 
and  eo^jerlence  level.  There  was  no  effect  of  MDPP  level  on  lock-on  rai^ 

[F(l,  14)  =  0.09,  E>.10].  Lock-on  was,  however,  p^onned  at  a  significantly 
greater  range  by  the  Hi^  E]^>eri^ioe  Qxiap  (1.45  kilometers)  than  by  the  1cm 
Experience  Grcup  (-0.97  kiloneters)  [£(1/  14)  =  4.61,  e<.05].  Again,  there 
was  no  interaction  between  MDPP  level  and  eoqperience  [£(1,  14)  =  0.36,  g>.10]. 


Table  7 

Lock-On  Range  in  Kilcmeters  for  Fixed-Wing  Aircraft  by  Conditions 


Statistic 

Low  Ejperienoe 
MDFPO  MDPP4 

Hi^  Experience 

MDPPO  MDPP4 

Mean 

-  1.07  ■ 

-  0.86 

1.77 

1.14 

SD 

3.04 

2.15 

2.69 

2.64 

N 

8 

8 

8 

8 

Note.  Positive  ranoes  are 

incoming; 

negative  ranges  are  outgoing. 

Table  8  presents  the  range  at  fire  as  a  function  of  MDPP  and  esgierience. 
There  was  no  significant  effect  of  MDPP  level  on  fire  range  CE(1,  14)  =  1.59, 
p>.10] .  Fire  was  performed  at  a  significantly  greater  range  by  the  Hi^ 
Experience  Group  (0.32  kilometers  versus  -1.85  kilcmeters)  [£(1,  14}  =  3.46, 
p<.10].  There  was  no  interaction  between  MDPP  level  and  experierioe  level 
[Z(l,  14)  =  1.18,  E>*10]. 


Table  8 

Fire  Range  in  Kilcmeters  for  Fixed-Wing  Aircraft  by  Conditions 


Statistic 

Low  Experimioe 
MDPPO  MDPP4 

Hic^  Experience 

MDPPO  M0PP4 

Mean 

-  1.79 

-  1.91 

1.13 

-  0.49 

SD 

2.00 

2.55 

2.84 

H 

8 

8 

8 

8 

Note.  Positive 

ranges  are  inocming; 

negative  ranges  are  outgoing. 
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Figures  1  thrcu^  4  display  the  IW  2drcraft  ran^  for  engagement 
events.  Figure  1  di^lays  the  results  for  all  ocnditicns  of  the  eaperiment. 
Figures  2  throu^  4  di^lay  subsets  of  these  results  vMch  hi^i^it  key 
effects  implicit  in  the  analyses  described  above. 

Figure  2  shows  the  range  of  engagement  actions  for  the  ICPPO  versus 
ICPP4  ccDpariscn  for  data  qTiwnaH  over  both  esqierlenoe  grci^.  Perfonnance  on 
the  identification  ta^  was  significantly  worse  under  ocxiditions  of  1CFP4. 
Figure  3  shows  the  range  of  engagement  actions  for  the  oonparison  between  the 
lew  Ejqserlence  Grocp  and  the  Hi^  Eiperienoe  GToep  for  data  summed  over  both 
conditions  of  ICPP.  Perfemanoe  vias  significantly  better  for  the  Hi^ 
Experience  GToip  on  the  acquisition  throu^  fire  tasks  by  a  mean  range  of  2.22 
kilometers. 

Figure  4  presents  a  cooparison  between  the  Low  Experi^ioe  Grexp  in  M3PP0 
and  the  Hi^  Experience  Grexp  wearing  IC)FP4.  In  this  cooparison,  the  I43PP4 
condition  was  not  inferior  to  the  MDEPO  condition  during  any  of  the  six 
engagement  tasks.  Ihat  is,  the  performance  of  the  High  Experience  Group  in 
MDPP4  was  not  degraded  relative  to  the  lew  Experience  Groip  in  MDPPO.  Ihis 
figure  provides  an  estimate  of  the  exetent  to  viiich  the  degradation 
attributable  to  wearing  MDPP4  can  be  alleviated  by  extensive  experience. 

Results  for  fixeed-wincr  aircraft;  Summary  Perfonnanoe  Measures,  nxe 
mean  percentage  of  adrezaft  detected  over  all  oonditiens  was  98.13.  Ihe  mean 
oonditional  probability  of  a  kill  given  fire  suaned  over  all  conditions  was 
63.81  percent. 

Table  9  presents  percent  adreraft  correctly  identified  (hostile  plus 
friendly)  as  a  function  of  N3PP  level  and  experience  level.  There  were  no 
statistically  significant  differences  as  a  function  of  H3FP  level  [£(1,  14)  - 
0.75,  p>.10].  Aircraft  were  identified  correctly  significantly  nxsre  often  by 
the  Hi^  Exqperienoe  Groip  (81.87%)  than  by  the  Lew  Exqperienoe  Groip  (56.93%) 
[F(l,  14)  =  17.11,  p<.001].  There  was  no  interaction  between  VDPP  level  and 
experience  level  [£(1,  14)  =  0.45,  e>.10]. 


Table  9 

Fixed-Wing:  Percent  Aircraft  Oorrectly  Identified  by  conditions 


Statistic 

low  Experience 
MDPPO  MDPP4 

Hi^  Experience 

MDPPO  MDFP4 

Mean 

56.37 

57.50 

77.50 

86.25 

SD 

20.28 

22.52 

7.07 

11.57 

H 

8 

8 

8 

8 
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Figure  1.  Range  of  engagement  actions  for  fixed-wing  targets: 
Ali  conditions. 
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MOPPO  versus  M0PP4  (summed  over  both  experience  groups). 
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FIgur#  3.  Range  of  engagement  actions  for  fixed-wing  targets: 
Low  Exp.  versus  High  Exp.  (summed  over  both  conditions  of  MOPP) 


Figure  4.  Range  of  engagement  actions  for  fixed-wing  targets 
Low  Exp.  Group  in  MOPPO  versus  High  Exp.  Group  in  M0PP4. 


Table  10  shews  percent  friaidly  edzeraft  oorzectly  identified  as  a 
function  of  J/DPP  level  and  es^ierl^ioe.  There  was  a  statistically  significant 
interaction  between  HOPP  level  and  e3g)erienoe  grotqp  [Z(if  14)  ==  9.00,  £<.01]. 
For  the  MT  groi^  their  correct  identification  rate  was  hic^n^  for  MOFPO  than 
IOPP4,  whereas  this  was  reversed  for  the  Southwest  Asia  grxxp.  This 
nonintuitive  reversal  in  correct  identification  rate  can  be  traced  to  Scenario 
2  vhich  featured  the  friendly  A7  aircraft.  The  Southwest  Asia  grotp 
consistently  misidentified  the  A7  as  "hostile”  while  in  MDPPO,  thereby 
lowering  their  percent  correct  rate  for  the  MOPPO  condition.  In  addition, 
there  was  a  significant  main  effect  of  esq^erienoe  [F(l,  14)  =  3.50,  e<.10], 
with  the  overall  correct  identification  rate  being  hi^ier  for  the  Hi^ 
Ejqerience  Graap  (62.50%)  than  for  the  low  Ebqerienoe  Groiq)  (50.00%) . 


Table  10 

Fixed-Wing;  Percent  Friendly  Aircraft  Correctly  Identified  by  Conditions 


Statistic 

Lew  E^qierienoe 
MDPPO  MDPP4 

Hi^  Ebqerience 

MDPPO  MDPP4 

Mean 

56.25 

43.75 

50.00 

75.00 

SD 

17.68 

17.68 

0.00 

26.73 

N 

8 

8 

8 

8 
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Table  11  shows  percent  hostile  edrcraft  oarrectly  identified  as  a 
function  of  MDPP  ocnditicn  and  experience  level.  There  was  no  statistically 
significant  difference  in  perfonaanoe  by  MDPP  level  UE(1,  14)  *  0.52,  ^>^.10]. 
The  correct  identification  rate  was,  however,  significantly  greater  for  the 
Hi^  E>?3erienoe  Group  [Z(l,  14)  =  10.26,  E<.01],  being  95.87  percent  correct 
overall  for  the  Southwest  Asia  grcxp  and  59.31  percent  correct  overall  for  the 
ATT  grxxp.  There  was  no  interacticn  between  ocnditicn  of  MDPP  and  level  of 
experience  [F(l,  14)  =  0.52,  pi>.10]. 


Table  11 

Fixed-Wing:  Percent  Hostile  Aircraft  Correctly  Identified  by  Oonditions 


Low  Experience  Hi^  Experience 

Statistic  MDPPO  MDPP4  MDPPO  MDPP4 


Mean 

52.00 

66.63 

95.87 

95.87 

43.17 

39.92 

11.67 

11.67 

8 

8 

8 

8 

Thble  12  displays  hostile  aircraft  attrition  aggregated  over  MDPP 
conditicxis  and  e}q?erience  gzcips.  There  was  no  statistically  significant 
difference  in  attrition  between  MDPPO  and  MDPP4  [F(l,  14)  =  0.15,  B>.10]. 
Attrition  was,  hcwever,  significantly  greater  for  the  Hi^  Experience  Grocp 
(73.00%)  than  for  the  lew  Experience  Group  (32.31%)  [F(l,  14)  =  7.89,  pc. 05]. 
There  was  no  interaction  between  MDPP  and  experience  [F(l,  14)  =  0.87,  e>.10]. 


Table  12 

Fixoed-Wing:  Percent  Hostile  Aircraft  Attrition  by  Oonditiens 


Low  Experience 
Statistic  MDPPO  MDPP4 


Hi^  Experience 
MDPPO  MDPP4 


Mean 

SD 

N 


27.13  37.50 
30.89  37.62 
8  8 


75.13  70.87 

23.59  37.57 

8  8 
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Table  13  di^lays  tbe  fratricide  rate  for  friendly  aircraft  aggregated 
over  the  ocnditicns  of  H3PP  and  e}g)eriaioe.  Fratricide  rate  was  significantly 
greater  in  M3PP0  (37.50%)  than  in  M3PP4  (15.63%)  [£(1,  14)  =  12.70,  pc.Ol]. 
Agcdn,  this  nonintuitive  result  can  be  traced  to  the  A7  2drcraft  presented  in 
Scenario  2.  Both  ejqjerienoe  groups  viere  nore  liicely  to  identic  the  friendly 
A7  as  "hostile"  and  fire  at  it  in  If3PP0  than  in  M3FP4,  thus  raising  tbeir 
fratricide  rates.  There  was  no  significant  difference  as  a  functicxi  of 
e}g}erienoe  level  [£(1,  14)  =  0.10,  £>.10],  and  no  MOPP  by  eagerienoe 
interaction  [F(l,  14)  =  2.33,  b>.10]. 


Table  13 

Fixed-Wing:  Pea^oent  Fratricide  by  Conditions 


Statistic 

low  Flxperienoe 
M3PP0  M3FP4 

Hi^  Fb^erienoe 

H3PP0  M3PP4 

Mean 

31.25 

18.75 

43.75 

12.50 

25.88 

25.88 

17.68 

23.15 

N 

8 

8 

8 

8 

24 


Table  14  sIkjws  the  percentage  of  hostile  aircraft  credited  as  destroyed 
("killed”)  prior  to  ordnance  release  as  a  function  of  M3FP  level  and 
es^erienoe  grocp.  (Ihe  ordnance  release  point  for  hostile  fW  cdrcxaft  was 
defined  as  two  kilcxneters  fron  the  weapon  position.  Killing  an  edrcraft  prior 
to  ordnance  release  was  defined  as  firing  early  encu^  in  the  engageoient 
sequence  to  allow  the  missile  time  to  intercept  the  fli^t  path  of  the 
eiircraft  prior  to  the  inocrung  cdrcraft  reaching  the  two  kilometer  point.) 
Ihere  was  a  significant  interaction  between  M3PP  level  and  experience  grcxp 
[F(l,  14)  =  8.04,  e<.05].  Ihe  High  E^periaice  Grop  had  a  hi^ier  kill  rate  in 
MDPPO  than  in  MDFP4,  vhereas  this  was  reversed  for  the  low  Experience  Grcip. 
This  nonintuitive  reversal  for  the  low  Experiaioe  Group  probably  reflects 
nothing  more  than  overall  poor  perfomanne  (i.e. ,  a  floor  effect)  since  the 
mean  kill  rate  for  this  groip  was  only  nine  percent.  Ihere  was  also  a 
significant  main  effect  of  experience  level  [£(1,  14)  =  3.46,  e<.10]  with 
overall  performance  for  the  Southwest  Asia  group  (31.13%)  being  better  than 
that  for  the  AIT  group  (9.37%) . 


Table  14 

Fixed-Wing:  Percent  Hostiles  Killed  Prior  to  Ordnance  Release  by  Oonditions 


Statistic 

Low  Experience 
M3PP0  MDPP4 

High  Exqxerience 

MDPPO  MDFP4 

Mean 

6.25 

12.50 

45.75 

16.50 

17.68 

24.87 

39.66 

17.64 

N 

8 

8 

8 

8 
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Results  for  rotaTy-wincr  aitcratTi:  Tasic  Fertormanoe  Measures. 
Generally,  the  shorter  the  eiigagemait  times,  the  better  the  perfamanoe. 
TEdsle  15  presents  the  tirrift  fron  target  available  to  detecrt  as  a  function  of 
M3PP  level  and  e}^)erienoe  level.  Detection  times  were  significantly  longer 
during  the  NDPP4  ocnditicn  (8.25  seconds)  than  during  the  ICFPO  oondition 
(7.09  seconds)  [F(l,  20)  =  6.44,  b<.05].  Ihere  was  no  statistically 
significant  effect  of  experience  level  [£(1,  20)  =  0.10,  E>.10],  and  no 
interaction  between  MOPP  level  and  experienoa  [Z(l,  20)  =  0.53,  £>.10]. 


Table  15 

Time  frcn  Target  Available  to  Detection  in  Seconds  for  Rotcury-Wing  Aircraft  by 
Conditions 


Lew  Ejgserienoe 
Statistic  MDPPO  MDPP4 


Hi^  E)qperienoe 
H3PP0  H3FP4 


Mean 

7.00 

8.50 

7.17 

8.00 

SD 

0.82 

2.37 

0.72 

2.05 

N 

10 

10 

12 

12 

Table  16  shews  the  time  from  detection  to  identification  (ID)  as  a 
function  of  conditions  of  M3PP  and  esq^erienoe.  Times  from  detect  to  ID  were 
significantly  longer  in  the  M3PP4  oondition  (10.61  seconds)  than  in  the  H3PP0 
condition  (8.83  seconds)  [F(l,  20)  =  4.89,  p<.053.  There  were  no 
statistically  significant  differences  as  a  function  of  esq^erienoe  level  [F(l, 
20)  =  0.17,  £>.10],  nor  was  there  a  MDPP  by  e^qperienoe  interaction  [F(l,  20)  = 
0.02,  £>.10]. 


Table  16 

Time  from  Detection  to  Identification  in  Seconds  for  Rotary-Wing  Aircraft 
Conditions 


low  Experience  Hi^  Experience 

Statistic  MDPPO  MDPP4  MDPPO  MDPP4 


Mean 


9.00  10.90 


8.67  10.33 


SD 

N 


2.31  4.75  2.15  3.11 

10  10  12  12 
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Table  17  di^lays  the  tiw*  fron  target  detection  to  IFF  interrogation  by 
coniitions  of  the  experiment.  Interrogation  times  were  significantly  longer 
in  the  MDFP4  condition  (4.13  seconds)  than  in  Idle  M3FP0  condition  (2.99 
seconds)  [Z(l,  20)  =  2.99,  E<.10].  mterrogaticn  times  were  significantly 
shorter  for  the  High  Experience  Groip  (2.67  seconds)  than  for  the  Lew 
Ej^erienoe  Group  (4.45  seconds)  [£(1,  20)  =  3.25,  b<.10].  Ihere  was  no 
interaction  between  MDEP  and  eaqierience  [£(1,  20)  =  0.01,  g^.lO]. 


Table  17 

Time  from  Detection  to  IFF  in  Seconds  for  Rotary-Wing  Aircraft  ty  Conditions 


Lew  Esgierience 
Statistic  M3PP0  MDPP4 


Hi^  Esqperience 
MDFPO  M3PP4 


Msan 

3.90 

5.00 

2.08 

3.25 

SD 

2.77 

3.53 

1.51 

3.14 

N 

10 

10 

12 

12 

Table  18  presents  the  time  from  detection  to  wee^xxi  acquisition  as  a 
function  of  MDPP  level  and  experience.  Ihere  was  a  statistically  significant 
interaction  between  MDPP  level  and  e>g)erience  grcn:;}  [£(1/  20)  =  5.16,  p<.05]. 
Ihe  Low  E^gierienoe  Groi^  Viewed  a  large  increase  in  acquisition  tixoe  for  the 
MJPP4  condition  (4.80  seconds — accounting  for  the  significant  main  effect  of 
MDPP  level  [£(1,  20)  =  7.85,  E<.05]),  vhile  the  Hi^  E>q)erienoe  Groqp  showed 
essentially  no  increase  in  acquisition  time  for  the  MDFP4  condition  (0.50 
seconds) .  Ihere  was  no  statistically  significant  main  effect  of  e^gierience 
level  vpon  acquisition  times  [£(1,  20)  =  2.68,  ^.10]. 


Table  18 

Time  from  Detection  to  Wee^xsn  Acquisition  in  Seconds  for  Rotary-Wing  Aircraft 
by  Conditions 


low  £>^>erience 
Statistic  MDPPO  MDPP4 


Hi^  E>q}erience 
MDPPO  MDPP4 


Mean 


8.40  13.20 


7.25  7.75 


SS 


3.78  7.48 


3.77  5.17 


N 


10  10 


12  12 
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The  mean  frcn  weapon  aoqiiisitlcn  to  lockron  farnnwi  over  all 
cxnliticns  was  4.09  secmds. 

Table  19  di^>lays  the  frcn  lock-on  to  fire  as  a  function  of  IDFP 
level  and  es^ierienoe  level.  Times  were  significantly  longer  for  the  M0FP4 
condition  (3.84  seconds)  than  for  the  H3PP0  condition  (2.81  seconds)  [£(1,  20) 
=  15.00,  E<.001].  Times  were  significantly  shorter  for  the  Hi^  Experience 
Group  (2.75  seconds)  than  for  the  low  Ejqjerienoe  Group  (3.90  seconds)  [F(l, 

20)  =  4.79,  b<.05].  There  was  no  interaction  between  M3PP  level  and 
experience  [£(!»  20)  »  1.89,  e>.10]. 


Table  19 

Time  from  lock-On  to  Fire  in  Seconds  for  Rotary-Wing  Aircraft  by  Oonditions 


Low  Experience 
Statistic  MDPPO  MDPP4 


Hi^  Experimice 
M3FP0  MDPP4 


Mean 

3.20 

4.60 

2.42 

3.08 

1.40 

2.17 

0.79 

0.90 

N 

10 

10 

12 

12 

T^le  20  presents  the  time  from  identification  to  fire  as  a  function  of 
MDFP  level  and  experience  grocp.  Times  were  significantly  longer  in  the  )C>FP4 
ocnditicn  (8.60  seconds)  than  in  the  MDFPO  condition  (5.95  seconds)  [£(1,  20) 

=  6.72,  p<.05].  There  was  no  significant  difference  as  a  function  of 
experience  group  [£(1,  20)  =  2.52,  p>.10],  and  no  interaction  between  ICFP 
level  and  experience  [£(1,  20)  =  2.60,  b>.10]. 


Table  20 

Time  from  Identificatian  to  Fire  in  Seconds  for  Rotary-Wing  Aircraft  by 
Conditions 


Lew  Experience 
Statistic  MDPPO  MDPP4 


Hic^  Experience 
MDPPO  MDEP4 


Mean 

11 


6.40  10.70 
3.50  7.33 
10  10 


5.50  6.50 
2.94  3.03 
12  12 
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Table  21  presents  the  cunulative  tine  of  the  engagement  from  detecticxi 
to  fire  by  oonditicns  of  the  experinent.  Tines  were  significantly  longer  in 
the  IOFP4  ocnditicn  (18.16  seconds)  than  in  the  M3FP0  cxsidition  (14.10 
seconds)  [F(l,  20)  »  10.22,  p<.01].  Ohere  were  no  statistically  significant 
differences  in  tines  as  a  function  of  eoperience  level  [£(1,  20)  =  2.58, 
^.10].  Also,  there  was  no  MOPP  level  by  experience  level  interaction  [£(1, 
20)  =  1.67,  E>-10]- 


Table  21 

Tine  from  Detection  to  Fire  in  Seconds  for  Potary-Wing  Aircraft  by  Conditions 

Low  Experience  Hi^  E^gierienoe 

Statistic  M3PP0  H0PP4  MOPPO  IOPP4 


Mean 

15.20 

20.90 

13.00 

15.42 

§D 

3.97 

10.74 

3.86 

4.79 

N 

10 

10 

12 

12 

Summarizing  the  results  presented  in  Tables  15  throu^  21  it  can  be  seen 
ttet  engagement  actions  required  more  time  to  be  performed  in  M0PP4.  Of  the 
eicjit  statistical  tests  of  the  MDPPO  versus  MDFP4  differences  in  perfomance 
(one  test  each  for  eight  TEHs) ,  seven  met  the  criterion  for  statistical 
significance.  Ihese  differences  can  be  seen  vhen  the  results  are  presented  in 
graphic  format.  Figure  5  di^lays  the  MDPPO  versus  MDPP4  conparisons  for  all 
TENS  for  data  summed  over  both  experience  gmps.  Of  the  ei^t  statisticed 
tests  of  the  lev  experience  versus  hi^  eperienoe  differences  in  perfomance 
(one  test  each  for  ei^t  TEMs) ,  two  met  the  criterion  for  statisticed 
significance.  Additioned  experience  served  to  reduce  some  engagement  tines. 
Ihis  experience  effect,  however,  was  not  pronounced.  Ihese  results  are 
presented  graphicedly  in  Figure  6  for  data  sunmed  over  both  conditions  of 
MDPP. 


An  estimate  of  the  effect  of  hi^  levels  of  experi&xxe  ipon  the 
reduction  of  the  MDPP4  decrement  is  displayed  graphiccdly  in  Figure  7.  This 
figure  presents  edl  ei^t  engagenent  action  tines  for  the  Low  Experience  Group 
in  the  MDPPO  condition,  the  low  Experience  Groip  in  the  MDPP4  condition,  and 
for  oenparison  the  Hi^  Experience  Group  in  the  MDPP4  condition.  Note  that 
the  Hi^  Experience  Grexp  in  MDPP4  required  less  time  than  the  Low  Experience 
Group  in  MDPP4  for  seven  of  the  ei^t  engagement  actions.  The  Hi^  Experience 
Group  wearing  MDPP4  required  5.48  seconds  less  time  to  perfonn  the  engagement 
sequence  from  detection  to  fire  than  did  the  Low  Exqxerlence  Group  wearing 
MDro4 — ^a  reduction  of  the  MDFP4  decrement  ^  96.14  percent.  That  is,  the 
MDPP4  decrement  recorded  for  the  lew  Experience  Group  was  zQnost  entirely 
removed  by  the  employment  of  Stinger  teams  who  had  received  high  levels  of 
training  in  and  experience  with  the  ohemical  protective  ensemble. 
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A-D  D-ID  D-IFF  D-Acq  Acq-LO  LO-F  ID-F  D-F 

Engagement  Actions 

■  MOPPO  B  M0PP4 

Figuro  5.  Time  to  perform  engagement  actions  for  rotary-wing 
targets:  MOPPO  versus  M0PP4  (summed  over  both  exp.  groups). 


Figur*  6.  Tim«  to  perform  engagement  actions  for  rotary-wing 
targets:  Low  versus  High  (summed  over  both  conditions  of  MOPP). 


Figure  7.  Time  to  perform  engagement  actions  for  rotary-wing 
targets:  Effect  of  experience  on  reduction  of  the  M0PP4  decrement. 


7V)o  special  Task  PerfoniBnoe  Measures  were  anadyzed — one  each  for 
Scenarios  12  and  13.  Scenario  12  presented  three  friendly  rotary-wing  targets 
g^Tmu-anPoiiaiy  for  a  totad  avedlable  duration  of  100  seconds  (see  Table  4) . 
Scenario  13  presented  th3:ee  hostile  rotary-wing  targets  siniiltanaously  for  the 
gamg  duration  (see  Table  4) .  In  each  scenario,  the  task  vas  to  process  all 
three  targets  before  they  descended.  These  two  scenarios  were  chosen  for 

analysis  becai,ifie  they  were  hi^-difficul'ty,  mdtiple-target  scenarios 
and,  therefore,  were  es^iected  to  tax  the  Stinger  teams.  Ecich  of  the  two 
special  measures  was  a  record  of  the  tot2d  time  in  seconds  from  initial  target 
availability  until  the  last  action  was  performed  on  the  third  target.  That 
is,  each  of  these  measures  represents  the  total  time  required  to  service  all 
three  sinultaneously-presented  targets.  The  "last  action"  to  be  performed 
would  be  a  cease  fire  for  a  third  target  identified  as  friendly  and  a  fire  for 
a  third  target  identified  as  hostile.  It  was  hypothesized  that  this  "time 
from  available  to  last  act"  would  be  longer  for  the  M3PP4  condition  and 
shorter  for  the  High  E>^)erienoe  Group. 

The  mean  riTn^  from  available  to  last  act  for  Scenario  12  summed  over  all 
conditions  was  47.76  seconds.  Table  22  di^lays  the  time  from  available  to 
last  act  for  Scenario  13  fen:  the  conditions  of  the  experiment.  Times  were 
significantly  longer  in  the  H3FP4  condition  (59.34  seconds)  than  in  the  M3PP0 
condition  (51.61  seconds)  [F(l,  20)  *  9.93,  pc.Ol].  There  were  no 
statistically  significant  differences  in  times  as  a  function  of  &perience 
level  [F(l,  20)  =  0.99,  E>.10],  and  no  interaction  between  M3PP  and  esperience 
[Z(l,  20)  =  0.68,  E>.10]. 


Table  22 

Scenario  13:  Time  frxxn  Available  to  Last  Act  in  Seconds  by  Conditions 


lew  E>perience  High  E^qperience 


Statistic 

M3FP0 

M3PP4 

M3FP0 

M3PP4 

Mean 

54.90 

60.60 

48.33 

58.08 

§D 

10.43 

13.98 

11.04 

12.78 

N 

10 

10 

12 

12 

Results  for  rotarv-wina  aircraft:  Summary  Performance  Measuripfi.  The 
mean  overall  percentage  of  £drcraft  detected  was  98.06.  The  mean  overall 
percentage  of  aircraft  correctly  identified  (hostile  plus  friendly)  was  72.48. 
The  mean  overall  percentage  of  friendly  eiircraft  correctly  identified  was 
57.91,  vhile  for  hostile  edreraft  the  percentage  was  86.71. 
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Table  23  di^lays  pensent  hostile  alxcxaft  attrition  as  a  function  of 
K>FP  level  and  ejiperienoe.  Significantly  more  hostile  aircraft  wexe  killed  in 
MDPPO  (84.78%)  than  in  VDFPA  (64.99%)  [£(1,  20)  =  13.05,  B<.01).  There  was  no 
significant  effect  of  esgierience  level  [£(l,  20)  »  0.23,  £>.10],  and  no  MSFP 
by  esgjerienoe  interacticn  [£(1,  20)  «  0.01,  £>.10]. 


Table  23 

Rotazy-Wing:  Percent  Hostile  Aircraft  Attrition  by  Ocnditions 


low  E>g)erienoe 
Statistic  M3PP0  MDPP4 


High  Ejgserience 
M3PP0  IDFP4 


Mean 

83.30 

63.30 

86.25 

66.67 

SD 

22.25 

24.67 

16.99 

15.83 

N 

10 

10 

12 

12 

Table  24  presents  the  percentage  of  hostiles  credited  as  killed  prior  to 
their  releasing  ordnance  by  conditions  of  M3PP  and  e3g)erience.  (The  ordnance 
release  point  for  hostile  IN  2drcraft  was  defined  as  20  seconds  from 
availability.  That  is,  a  hostile  aircraft  was  assumed  to  be  callable  of 
releasing  ordnance  if  net  killed  pricu:  to  20  seconds  fren  availedsility.  In 
order  to  previait  ordnance  release  the  team  must  fire  at  the  target  early 
enou^  in  the  scenario  to  allow  missile  fli^xt  time  to  target  within  20 
seconds  fran  availability.)  The  percent  hostiles  killed  prior  to  ordnance 
release  was  significantly  greater  in  MDPPO  (28.01%)  than  in  MDPP4  (16.79%) 

[£(1,  20)  =  7.77,  £<.05].  There  was  no  statistically  significant  difference 
as  a  fUnc±ion  of  experience  level  [£(1,  20)  =  2.59,  £>.10],  and  no  interaction 
between  M3PP  and  experience  [£(1,  20)  =  0.13,  £>.10]. 


Table  24 

Rotary-Wing:  Percent  Hostiles  Killed  Prior  to  Ordnance  Release  by  Conditions 
low  Experience  Hi^  E)qariaice 


Statistic 

MDPPO 

MDPP4 

MDPPO 

MDPP4 

Mean 

22.70 

10.00 

33.33 

23.58 

26.15 

13.97 

20.05 

17.96 

a 

10 

10 

12 

12 
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Ihe  meaoi  fratricide  rate  over  all  ocnditicns  was  36.39  percent.  Die 
mean  ccnditicnzd  probability  of  a  credited  kill  given  a  fixe  was  97.20 
percent. 

Stress  Ratines 

The  stress  questionnaire  (Self~Evaluation  Questionnaire,  ^ielberger, 
1983)  was  adninistered  twice  during  each  session  ■once  just  prior  to  beginning 
and  agedn  just  after  finishing  each  session.  Die  Mam-Miitney  Q  test  for 
between-grtxps  cooparisons  and  the  Wilcoooxi  X  test  for  witiiin-group 
cenparisons  (Bruning  &  Kintz,  1977)  were  used  to  analyze  the  stress  ratings 
given  by  the  low  and  Hi^  Experlenoe  Greu^.  Cn  three  of  four  contrasts,  the 
low  and  Hi^  Eiqperienoe  Groips  differed  significantly  fcon  each  other  in 
reported  stress  levels  (see  Figure  8) .  Prior  to  MOFFO  and  M3FF4  trials  and  at 
the  conclusion  of  MOFFO  trials,  the  stress  levels  reported  by  Idie  Lew 
£)perienoe  Group  were  greater  than  those  reported  by  the  High  Experience  Groip 
[Pretest  MOFFO:  11(24,  24)  »  122.5,  p<.001;  Posttest  MOFFO:  £[(22,  24)  =  161, 
p<.02;  Pretest  M0FF4:  11(20,  24)  =  129.5,  fic.Ol].  However,  at  the  conclusion 
of  the  M3FP4  condition,  stress  levels  were  not  significantly  different  between 
the  two  groips  [Posttest  M0FF4:  12(20,  24)  =  219.5,  p>.05]. 

Both  experience  groips  reported  significantly  hi^ier  stress  levels 
before  and  after  the  M0PP4  condition  when  coopaxed  to  the  MOFFO  condition  [Low 
Pretest  MOFFO  vs.  M0FF4:  X  =  4,  p<.005,  H  =  20;  Low  Posttest  MOFFO  vs.  M0FF4: 
1  =  25,  E<.005,  Ji  =  18;  Hi^  Pretest  MOFFO  vs.  M0FP4:  X  *  35.5,  p<.001,  H  = 
24;  High  Posttest  MOPFO  vs.  M0PP4:  X  “  21,  b<.0002,  H  *  24].  Although 
reported  stress  was  greater  fen:  M0FP4  than  MOFFO,  stress  ratings  did  not 
increase  significantly  over  the  13  trials  in  each  clothing  condition  for 
either  groip  [Low  MOFFO  Pretest  vs.  Posttest:  X  =  63,  e>.05,  fi  =  18;  Low 
M0PP4  Pretest  vs.  Posttest:  X  *=  63.5,  £>.05,  =  20;  High  MOFFO  Pretest  vs. 

Posttest:  X  =  118.5,  E>.05,  H  *  24;  Hi^  M0PP4  Pretest  vs.  Posttest:  X  = 
102.5,  ^.05,  N  *  24,  (see  Figure  9)]. 

Workload 

Die  workload  questionnaire  (TLX  Fating  Scales,  NASA-Ames,  1986)  was 
administered  imnediately  after  each  data  trial  during  both  MOFFO  and  M0FP4 
sessions.  Die  TLX  workload  ratings  collected  fren  the  Stinger  teams  were  used 
in  the  relative  sense,  oonparing  conditions  to  ascertain  which  were  perceived 
as  having  higher  workload.  Die  workload  data  were  sidsjected  to  a  nixed,  three 
factor,  repeated  measures  Analysis  of  Variance  (Nocusis,  1986) .  Eiperience 
level  (low,  hi^)  was  the  between-subjects  factor.  MOPP  level  (MOFFO,  M0FF4) 
and  scenario  difficulty  (low,  medium,  hi^)  were  the  within-subjects  factors. 

Diere  was  no  main  effect  of  eiperlenoe  [£(1,  30)  >  1.74,  £>.05] 
indicating  that  reported  workload  was  not  different  between  the  Low  and  High 
Eiperience  Groips.  Die  mean  workload  rating  across  these  groips  was  34.81. 

As  eipected,  there  was  a  main  effect  of  MOFP  [£(1,  30)  «  49.51,  gc.OOl]  with 
workload  ratings  being  significantly  greater  in  M0FF4  (42.85)  than  in  MOFFO 
(26.77).  Diere  was  also  a  significant  scenario  difficulty  effect  [£(2,  60)  » 
12.86,  £<.001].  L%u±icipants  responded  differential ly  to  scenario  difficulty 
by  assigning  greater  workload  to  the  more  demanding  scenarios.  Die  mean 
workload  ratings  were  30.84  for  low  difficulty  scenarios,  34.22  for  medium 
difficulty  scenarios,  and  39.36  for  high  difficulty  scen^os. 
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Use  experienoe  ty  M3PP  [Z(l»  30)  -  0.39,  B»>.05],  experienoe  by  aoenarlo 
difficulty  [£(2,  60)  =  1.17,  B>*05],  and  M3PP  by  scenario  difficulty  [£(2,  60) 
*  1.00,  E>.05]  intexacticns  were  not  significant.  HcMever,  tlie  experience  by 
M3PP  by  scenario  difficulty  interacticn  vaa  significant  CE(2»  60)  *  3.47, 
g<.05] . 
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■  LOW  EXP.  ^  HIGH  EXP. 

Figure  8.  Stress  levels  reported  by  soldiers  in  Low  Experience  Group  and 
High  Experience  Group  before  and  after  the  MOPPO  and  M0PP4  conditions. 


ONIXVU  SS3U1S 


38 


LOW  EXP-PRETEST  HIGH  EXP-PRETEST 

LOW  EXP-POSTTEST  HIGH  EXP-POSTTEST 

■  MOPPO  ^  M0PP4 

Figure  9.  Comparison  of  MOPPO  and  M0PP4  protest  and  posttest  stress  means 
for  both  experience  groups. 


Discussion 


Etxaggnent  Perf onnanoe 


TSvpri-wincr  airririrft.  The  only  statistically  significant  effect  of 
wearing  on  fW  task  performance  was  to  delay  identification  range  by 

kilcmsters.  Ihis  deanaiwnfc  in  identification  range  could  han^  been  caused  by 
the  difficulty  team  chiefs  reported  (see  i^pendix  B)  in  atbenpting  to  identic 
flying  ciircraft  with  binoculars  vhile  wearing  tiie  mask.  It  has  already  been 
reported  (Harcah,  1985)  that  the  na^'binocular  interface  produces  a  nainxiw 
field  of  view.  This  narrow  field  of  view  makes  trekdldng  a  maneuvering,  flying 
aircraft  difficult.  In  addition  to  this  tracking  problem,  team  chiefs 
reported  double  images.  In  an  atteopt  to  alleviate  the  double-image  problem, 
team  chiefs  closed  one  eye  or  otherwise  used  only  one  optic  of  the  binoculars. 

The  overall  effect  of  hi^  eoperience  was  to  improve  the  range  at  vhich 
engagement  events  took  place.  Of  the  six  engagement  actions  measured,  the 
ranges  of  four  (accpiisition,  identification,  lock-on,  and  fire)  were  greater 
by  a  statistically  significant  amount  for  the  High  Esqperienoe  Group.  The  mean 
improvement  for  these  four  tasks  was  2.22  kilcmeters  (see  Figure  3) .  Mote 
that  this  improvement  attributable  to  increased  eaperience  did  not  occur  early 
in  the  engagement  sequence  (detection) ,  %here  performanoe  is  strongly 
influenced  fay  visual  sensitivity  (Barber,  1990c) ,  but  later  (aoguisiticn 
throu^  fire)  where  perfomanoe  xcey  be  more  strongly  affected  by  increased 
knowledge,  training,  and  ^11. 

Also,  the  Hic^  Ejperienoe  Group  identified  both  friendly  and  hostile 
aircraft  more  accurately,  killed  more  hostile  aircraft,  and  killed  a  greater 
percentage  of  these  hostile  edrcraft  prior  to  ordnance  release.  Thus,  the 
Hi^  Experience  Group  were  both  more  efficient  and  more  effective  at 
performing  their  engagpement  tasks  than  the  Low  Ejperience  Group. 

Ey  providing  Stinger  teams  with  extensive  esperlenoe  wearing  and 
training  in  the  I13FP4  chemical  protective  clothing,  is  it  possible  to  reduce 
the  degradation  in  performance  attributable  to  IOiEP4?  The  answer  appears  to 
be  a  qualified  yes.  Ocnpare  the  perfomance  of  the  Hic^  Ebperlenoe  Group  in 
I43FP4  with  that  of  the  Low  Experience  Group  in  ICFFO  (see  Figure  4) .  The 
performanoe  of  the  experienced  group  in  M3FP4  showed  no  degradation  whatsoever 
relative  to  the  ncvioe  group  in  M3FP0.  This  conclusion  is  qualified,  however, 
by  the  fact  that  these  two  groups  of  soldiers  were  chosen  as  the  opportunity 
arose  and,  therefore,  were  not  matched  on  all  potentially  relevant  criteria. 

ItotarY-w5na  aircraft.  Overall,  the  effect  of  wearing  M3FP4  was  to 
increase  the  time  required  for  an  engagement.  Of  the  eight  engagement  actions 
recorded,  seven  required  statistLcally  significantly  more  time  to  be  performed 
when  wearing  HDPP4  (see  Figure  5) .  Over  the  engagement  serguenoe  from 
detection  to  fire,  the  extra  time  required  for  the  MDFP4  ooidition  was  4.06 
seconds  (see  Table  21).  This  was  a  29  percent  increase  (4.06  /  14.10  »  0.29). 
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Further,  wearing  ICPE^  harmad  the  eigaganent  efficiency  of  both  the  team 
chief  and  the  gunner.  The  engagenent  period  detect  to  identic  was  entirely 
d^jendent  the  taloen  by  the  team  chief,  using  binxulars,  to  identify 
the  target.  The  engagement  period  identify  to  fire  was  entirely  dependent 
upon  the  gunner.  The  effect  of  wearing  ICFP4  was  to  increase  the  time 
required  by  both  members  of  the  team.  There  was  no  evidence  in  these  data 
that  the  effects  of  wearing  M3FP4  were  limited  to  a  single  'Txjttleneck"  in  the 
engagement  sequence. 

Specifically,  vhat  was  it  about  wearing  )OFF4  that  caused  this 
degradaticn  in  FW  engagement  perf ormance?  The  increased  time  from  available 
to  detect  was  most  likely  caused  by  the  restricted  field  of  view  of  the  mask 
(Bensel  et  al.,  1987;  Ki±)rick  &  Sleeper,  1986).  The  increase  in  detect  to 
identify  time  could  have  been  caused  by  the  difficulty  team  chiefs  reported 
(see  ;^}penclix  B)  in  attempting  to  use  the  binoculars  with  the  mask.  TSam 
chiefs  reported  a  double-image  problem  with  oonsequmit  visual  disorientation 
and  "solved"  it  by  using  only  one  eye.  This  could  have  delayed  identification 
of  the  FN  aircraft  vhich,  being  3.5  kilometers  distant,  were  not  identifiable 
witliout  magnification. 

At  least  part  of  the  increase  in  time  from  identify  to  fire  could  have 
been  caused  ly  the  difficulties  reported  by  gunners  (see  Appendix  B)  in 
attempting  to  use  the  Stinger  si^t  reticle  vhile  wearing  the  mask.  Gunners 
reported  difficulty  acquiring  aircraft  in  the  reticle  ^Mle  wearing  the  mask. 
Perha^  more  iitportantly,  gunners  reported  difficulty  inserting  siperelevate 
and  lead  angle  because  the  mask  prevented  them  from  seeing  the  superelevate 
and  lead  reticles  in  the  si^t.  This  interpretation  is  supported  by  the 
significant  increase  in  times  from  lock-on  to  fire  shown  for  the  MDPP4 
condition  (Figure  5  and  Thble  19) .  Insertion  of  the  stperelevate  and  lead 
angle  takes  place  between  lock-on  and  fire.  Thus,  it  is  a  reasonable 
assunption  that  the  prinary  cause  of  the  performanoe  degradation  shown  for  FN 
aircraft  in  this  eaqaeriment  was  the  mask. 

Under  oonditions  of  NDFP4  the  percentage  of  hostiles  killed  was  lower 
and  die  percentage  of  hostiles  killed  prior  to  ordnanoe  release  was  lower. 
These  results  can  be  e^qplained  in  terms  of  the  increased  timp  requir.^  for 
engagements  in  M3FP4.  The  more  time  the  engagement  sequence  requires,  the 
greater  the  probability  that  the  hostile  edrcraft  will  have  released  its 
ordnanoe  and  then  have  returned  to  its  defilade  position,  ther^  being 
unavailable  to  kill.  Thus,  wearing  M3PP4  harmed  both  engagement  efficiency 
and  engagement  effectiveness. 

Stress  And  Workload 

Ocmpared  to  the  M3PP0  condition,  participants  reported  both  greater 
levels  of  stress  and  greater  levels  of  workload  vhen  wearing  the  chemical 
protective  clothing.  This  was  true  both  for  the  Low  E>^)erience  Group  and  for 
tlie  Higti  Ejperience  Group. 
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The  statistically  significantly  different  stress  ratings  given  by  the 
Low  Ejqjerience  Group  prior  to  MOPPO  and  M0PP4  trials  and  after  MDPPO  trieils 
likely  reflect  their  minimal  ejqserience,  their  uncertainty  about  acting  as  a 
team,  and  also  their  apprehension  about  performing  in  the  chemical  protective 
clothing.  Ihe  non-statistically-significant  stress  levels  reported  by  both 
groi^js  at  the  conclusion  of  the  sequence  of  M0PP4  trials  may  suggest  that 
wearing  M0PP4  gear  is  a  stressful  event  regardless  of  the  extent  of  prior 
ejqierience  with  the  clothing. 

The  higher  workload  reported  by  both  the  Low  and  High  Esqjerience  Groi;?© 
while  wearing  M0PP4  gear  appears  to  have  as  its  source  the  reduced  field  of 
view  created  by  the  chemical  protective  mask.  The  lenses  of  the  gas  mask 
produce  a  stand-off  problem  for  both  the  team  chief  and  gunner  vhich  reduces 
the  field  of  view  vhen  the  mask  is  used  in  conjunction  with  the  M19  binoculars 
and  Stinger  si^t.  The  reduced  field  of  view  makes  it  much  more  difficult  to 
perform  the  tasks  of  the  engagement  sequence  such  as  detecting,  tracking,  and 
identifying  targets. 

Although  the  rubber  gloves  initially  interfered  slightly  with  manual 
dexterity,  they  did  not  appear  to  create  serious  problems  for  either  the  team 
chief  or  gunner.  The  overgarment  and  boots  were  reported  as  being 
uncomfortable  and  awkward,  but  again,  they  did  not  produce  serious  or 
persistent  problems  for  the  teams. 

Examination  of  the  statistically  significant  interaction  of  experience, 
MDPP  level,  and  scenario  difficulty  (see  Figure  10)  revealed  that  the  level  of 
workload  reported  by  the  Hi^  Experience  Group  increased  as  scenario 
difficulty  increased  under  both  clothing  conditions.  This  was  not  true  for 
the  Low  Experience  Group,  however.  Under  conditions  of  MOPPO  this  grocp 
viewed  the  low  and  medium  difficulty  scencurios  as  being  of  equal  and 
relatively  low  workload,  vhile  under  conditions  of  M0PP4  they  viewed  all  the 
scericurios  as  being  of  necurly  equal  and  relatively  workload. 

These  results  are  understandable  vhen  one  takes  into  consideration  that 
the  soldiers  in  the  Low  Experience  Group  were  working  together  as  team  chief 
and  gunner  for  the  first  time  and  that  they  liad  minimal  training  in  the 
chemical  protective  clothing.  In  this  experiment,  the  soldier  of  low 
experience  vho  was  not  encumbered  by  a  gas  mask  found  one  target  sceneurios, 
whether  they  consisted  of  fast  moving  or  static  scale  models,  to  be  equally 
easy.  However,  when  encumbered  by  the  gas  mask  and  handicapped  by  the  field 
of  view  problem  it  created,  this  same  soldier  found  the  engagement  of  all 
targets  in  all  scenarios  to  be  relatively  difficult. 

However,  neither  the  behavior  of  the  particip)ants  during  this 
experiment,  nor  the  resultant  data  suggest  that  the  amount  of  stress  and 
workload  experienced  by  either  group  was  excessive.  All  psarticipjants  finished 
the  sequence  of  M0PP4  trials  uneventfully.  No  individual  needed  to  remove  his 
protective  gear  during  the  sequence  of  trials  nor  did  anyone  request  to  be 
withdrawn  from  the  ej^riment.  It  is  very  ijrportant  to  recall  here,  however, 
that  these  data  were  collected  under  benign  environmental  conditions  where 
participsants  were  not  subjected  to  heat  stress,  to  movement  stress,  or  to 
sustained  operations. 
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Figure  10.  Interaction  of  experience  level,  MOPP  gear,  and  scenario  difficulty. 
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Ihe  engag€9Dent  perfomanoe  of  Stinger  teams  was  degracled  by  wearing  the 
1CFP4  chemical  protective  ensemble.  The  visual  i dentif ication  range  for 
fixed-wing  aircraft  was  decreased  by  1.63  kilcmeters.  The  time  required  to 
ocnplete  an  engagement  of  a  rotary-wing  aircraft  was  increased  by  4.06  seconds 
or  29  percent.  Wearing  the  chemical  protective  clothing  adversely  affected 
the  perfoCTianoe  of  both  team  chiefs  and  gunners.  The  article  of  K>PP4 
clothing  responsible  for  this  reduction  in  engagement  efficiency  was  judged  to 
be  the  gas  mask. 

Stinger  teams  were  less  effective  in  performing  their  air  defense 
mission  while  dressed  in  M3FP4.  When  engaging  rotary-wing  edrcraft  under 
conditions  of  ICPP4,  Stinger  teams  killed  a  lower  percentage  of  hostiles 
overall  and  killed  a  lower  percentage  prior  to  ordnance  release. 

The  engagement  performance  of  the  Hi^  Experience  Groip  (veterans  of 
Cperations  Desert  Shield  and  Desert  Stc»mx)  was  better  than  that  of  the  Lew 
Experience  Grtxp  (ATT  trainees)  both  in  MDPPO  and  MDPP4.  The  overall  effeot 
of  high  experience  on  the  engagement  of  fixed-wing  aircraft  was  to  increase 
the  range  at  vhich  engagement  events  occured.  The  veterans  acgiired, 
identified,  locked-cnto,  and  fired  at  fixed-wing  edrcraft  an  average  of  2.22 
kilometers  earlier  than  the  trainees.  This  inprovement  in  engetgement 
efficiency  was  attributed  to  their  extensive  training  with  and  experience 
wearing  MDPP4.  The  veterans  also  performed  their  air  defense  mission  more 
effectively  by  identi^ing  edrcraft  more  accurately,  killing  a  greater 
percentage  of  hostiles,  and  killing  a  greater  percentage  of  these  hostiles 
prior  to  ordnance  release. 

Flirted  stress  levels  were  hicher  when  Stinger  teams  wore  1CEP4  than 
MDPPO.  R^xxrted  workload  levels  were  hicher  vrfien  Stinger  t-j^aing  wore  MDPP4 
than  MDPPO. 
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Oitline  of  BaQ±icipant  Briefiin 


1.  fftio  we  are:  U5AKI. 

2.  Mhat  we  do:  i^lied  hunan  perfomanoe  research  related  to  perforrnanoe 
evaliiaticn,  trEdning,  aptitude  measurenent,  and  1C6  dassificaticn. 

3.  Present  project:  Collect  performanoe  data  from  Stinger  teams  under 
oonditicns  of  wearing  or  not  wearing  chemical  protective  clothing.  Data  will 
be  collected  in  the  Range  Target  System.  Prcponent  for  this  research  is 
Directorate  of  Ocnhat  Developments,  US  Aray  Air  Defense  Artillery  School. 
Sponsor  for  this  research  is  Directorate  of  Ocnbat  Developments,  US  Anoy 
Chemical  School. 

4.  Your  job: 

(a)  Engage  Edrcraft  xising  the  Stinger  HIT  xmder  conditions  of  M3FP0  and 

M3PP4. 

(b)  Fill  out  self-evaluation  questionnaire  and  wcricload  questionnaire. 

5.  Mhat  is  RES?  Engagement  simlation.  Air  defenders,  with  their  edr 

defense  weepon  systems,  in  field  envircnDoent,  in  engagement  of 

subscale  friendly  and  hostile  fixed-wing  and  rotary-wing  aircraft.  Weepons 
are  oonnecbed  to  RES  oonputer  network.  Gunner  events  recorded  automatically 
via  voltage  tEps  on  key  weapon  pins.  Team  chief  verbal  responses  (detect,  ID, 
cooraand  engage,  or  cease  engagement)  recorded  by  data  collector  at  weepon 
position.  Data  collected  are  engagement  times,  engagement  ranges,  and  percent 
correct  actions.  Laser  Position  Location  Syst^.  Stinger  missile  math  model. 
Give  exanples  of  performanoe  measures. 

(a)  Fixed-wing  targets  are  flying  scale  models  of  US  and  Soviet  attack 

jets. 

p)  Rotary-wing  targets  are  static  scale  models  of  US  and  Soviet  attack 
and  utility  heliocpters,  vhich  pcp-vp  from  bdiind  sand  dunes,  hover  with  rotor 
turning,  and  descend. 

6.  Weapon  position:  Ihere  are  four  separated  weapon  positions.  Earh  is 
re^xxisible  for  90  degree  search  sector.  Left  sector  limit,  ri^^  sector 
limit,  and  primary  target  line  are  marked.  At  each  position:  One  team  chief, 
one  gunner,  one  Stinger  nir  cabled  to  RES,  and  one  data  ooUector.  Data 
collector  is  in  oonnunicaticn  with  RTS  Oontrol.  Data  ool lector  is  not  on  your 
team,  has  a  job  to  do,  and  will  not  help  with  your  engagement. 

7.  TriEds  and  procedures:  TVro  data  collection  sessions  in  a  (one  session 
in  AM,  one  session  in  EM;  one  session  is  MDFPO,  one  session  is  M3E^) . 

Thirteen  data  trials  and  one  practice  trial  per  session.  Always  aircraft  in  a 
trlEd,  no  fsdse  alarms.  Aircraft  Edways  in  your  search  sector,  no  cheating  on 
cur  part.  We  are  only  here  to  measure  your  perfarmanoe  wearing  MQFPO  and 
IOFP4. 

(a)  You  will  be  in  Woapono  Oontrol  Status  Tight:  Ebsitive  visual  ID 
required.  Hostile  criterion  is  edrcxaft  origin;  US  models  are  friendly, 

Soviet  models  are  hostile.  Use  aircraft  silhouette  for  visual  ID. 
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(b)  Trial  liinits: 

-  Trial  begiis  with  alert  message  fron  your  data  ooUectcr  C^ted 

Ti^t”) . 

-  Trial  ends  with  diange  in  alert  status  from  your  data  ooUector 
("Betum  to  Oondition  Yellow") . 

-  Between  trials  put  Stinger  THT  down,  sit  with  badcs  to  range, 
fill  out  worklOEKi  guestiamaire. 

(c)  Aircraft: 

-  On  arv  given  trial  you  can  eaqpect  to  see  fixed-wing,  rotary¬ 
wing,  or  a  mix  of  the  two;  friendly  ca:  hostile;  single  or  multiple. 

-  Scenarios  have  been  chosen  to  vary  fron  ea^  to  difficult. 

-  Remenber  to  continue  searching  for  aircraft  until  your  data 
collector  tells  you  that  the  trial  is  over. 

8.  Responsibilities ; 

(a)  Team  Chief: 

-  Detect  plus  clobk  azimuth  pl\m  point  (say  "target,  12  o'docl^ 
and  point  with  free  hand) .  Do  not  \:ise  binoculars  for  detection,  they  will 
harm  your  performance. 

-  Visual  ID,  tactical  ID  (say  "hostile"  or  "friendly") .  Use 
binoculars  for  ID. 

-  Engaganent  or  cease  engagement  ccmnand  (say  "engage"  or  "cease 
engagement") . 

-  Control  your  gunner.  It  is  your  respcnsibilil^  to  hand  off 
targets  to  gunner,  to  control  the  aigagement,  to  be  certain  your  gunner  is 
engaging  the  targ^  you  have  identified. 

(b)  Gunner: 

-  We  want  a  conplete  engagement:  IFF  interrogation.  Stinger 
activation,  trade,  acquire,  lock-on,  siperelevate,  fire,  or  cease  engagement, 
d^)ending  vpon  ID. 

-  One  fire  only  per  hostile  target.  Remenher  to  recycle  battery 
between  target  engagements. 

-  You  are  under  team  chief's  control.  Do  not  engage  any  target 
until  ordered  to  do  so. 

(c)  Both:  Hand  off  targets  to  each  other.  You  are  a  team,  work 
togeth^.  If  gunner  detects  a  target  before  team  chief,  hand  it  off  to  team 
chief.  If  gunner  knews  aircraft  ID,  tell  team  chief. 


9.  QuestionnEdres: 

(a)  You  will  fill  out  two  questionnaires — ^the  self-evaluation 
questionnaire  and  the  workload  questionnaire.  Give  them  examples  of  both. 

(b)  Hiis  is  the  self-evaluation  questionnEiire.  It  oontedns  a  series  of 
statements.  After  reading  each  statement,  you  will  decide  hew  well  it 
describes  vhat  you  are  feeling  at  that  pai±icular  moment  and  fill  in  the 
appropriate  circle.  You  will  fill  out  this  questionnedre  four  times,  before 
and  adter  both  the  ICFPO  and  )DPP4  sessions.  Do  example.  Questions? 

(c)  This  is  the  workload  questionnaire.  We  are  going  to  ask  you  to 
fill  out  one  after  every  trial  today.  You  will  see  a  line  below  triad  nunber 
for  scenario  nunber.  At  the  end  of  each  trial,  the  data  collector  will  tell 
you  vhich  scenario  it  was  and  you  will  place  that  nunber  on  the  line.  Using 
this  questionimize,  we  are  asking  you  to  tell  us  how  much  workload  you 
experienced  on  that  pau±icular  triad  along  six  dimensions — mental  demand, 
physical  demand,  temporal  demand,  performanoe,  effort,  and  frustration.  Platoe 
an  "X"  on  the  appropriate  line  adong  the  scale  for  each  dimension.  Do 
example.  Questions? 
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10.  Feedback:  You  vill  xeoeive  feedback  cn  your  perfataanoe  at  tte  end  of 
the  day's  activities,  not  trial  by  trial. 

11.  Safety:  You  are  in  tiie  desert,  so  drirk  water  vbether  you  feel  bursty 
or  not.  If  you  nm  out  of  water  ve  hacve  nore. 

12.  Anonymity:  All  research  results  eoe  reported  by  unit  designation  only. 
Your  personal  anonymity  is  assured. 


13.  Questions? 


14.  Travel  to  wee^icn  positions.  Introduce  each  team  to  their  data  collector. 
Shew  team  left  and  ri^t  sector  limits  and  primary  target  line. 
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Probleng  usim  M19  binoculars  wit^  ™«ic-  AU  team  diiefs  interviewed 
(sore  than  half  were  interviewed)  reported  problems  using  the  binoculars  with 
the  mask.  Uiey  reported  tunnel  vision;  double  vision;  visu2d  disorientation; 
difficulty  tracking  maneuvering  aircraft  %dth  the  small  field  of  view 
available;  cannot  get  the  binoculars  close  enough  to  their  eyes;  eyepieces  of 
binoculars  slipped  on  surface  of  mask  ey^ieoes.  Gne  of  the  authors 
eagierienced  edJL  of  these  problems  vhen  using  the  binoculars  with  the  mask. 

ISie  "work-around"  solutions  enployed  by  team  chiefs  were  to  (1)  close  one  eye, 
(2)  close  am  eye  and  only  look  through  one  optic  of  the  binoculars  by  turning 
th^  sideways,  or  (3)  not  irse  binoculars  at  all. 

Problems  using  the  stinopr  sicht  with  imgV.  All  gunners  interviewed 
(more  than  half  were  interviewed)  reported  problems  using  the  Stinger  si^it 
with  the  mask.  Ihey  reported  difficulty  tracking  maneuvering  edrcreift  with 
the  tiny  field  of  view  available;  cannot  get  the  si^it  close  enou^  to  their 
eyes;  cannot  see  ary  (or  cannot  see  all  three,  or  cannot  see  rl^xt-most) 
scperelevate  and  lead  reticles  in  the  Stinger  si^it.  One  of  the  authors 
esperienced  all  of  these  problems  when  using  the  Stinger  sic^  with  the  mask. 
Ohe  "work-around"  solutions  enployed  by  gunners  were  to  (1)  manually  estimate 
the  appropriate  scperelevate  and  lead  angles  before  firing,  or  (2)  slip  the 
mask  subtly  (breaking  seedl)  in  order  to  see  the  siperelevate  and  lead 
reticles. 

Miscellaneous  problems.  Ocnnunicaticn  problems  were  observed  for,  and 
reported  by,  the  lew  Experience  Gnxp  (AET) .  Stinger  teams  stand  literally 
ri^t  next  to  each  other  during  an  engagement  and  ocmounicate  directly  without 
ciid  of  field  telephone  or  radio.  Ihe  oonnunication  problems  were  not  in 
reception  with  the  ma;^  and  hood  on  but  in  transmission  with  the  mask  and  hood 
on.  The  mask  distorted,  muffled,  and  attenuated  the  sound  of  the  qpeaker. 
Soldiers  experienced  no  difficulty  vhatsoever  hearing  and  understanding  USARI 
test  personnel  who  were  not  ^leaking  throu^  a  mask,  but  even  unmasked  U5API 
test  personnel  had  difficulty  xmderstanding  masked  test  participants  vhen  they 
were  ^xeaking.  One  of  the  authors  experienced  this  same  problem  when  wearing 
the  mask  and  hood.  The  '^work-around"  solution  enployed  soldiers  was  hand 
signals.  Far  fewer  ocnmunicaticn  problems  were  ebserved  for  the  Hi^ 
Experience  Group  (veterans  of  Cperations  Desert  Shield  and  Desert  Storm) . 

The  veterans  frequently  r^rted  that  the  rubber  liner  inside  the  M40 
mask  pressed  on  both  sides  of  the  bridge  of  the  nose,  squeezing  the  nose,  and 
thereby  restricting  the  passage  of  edr  and  causing  pain. 


Prcblero  inserting  IFF  cable  into  oriostock  of  Stinger.  Observed  for  all 
ATT  gunners  initially.  Problem  solved  with  experience  over  trials. 
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Problem  turning  caper  pages  wltii  cdcwed  harate.  Obseivad  tar  all 
soldiers.  All  soldiers  eventually  learned  tte  ^ork-arcund''  solxition  of  using 
the  eraser  of  a  pencil  to  turn  pages. 

overcarinent 

Gunners'  pants  frequently  came  unsnarned  from  jacket  and  si  icned  down. 

No  solution  found.  Ihe  veterans  reported  that  this  problem  was  fregiiently 
observed  during  Operations  Desert  Shield  and  Desert  Stora. 
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